00000001:02000400:3.0F:1789122926.995189:0:2956:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1789122941.442564:0:3179:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1789122943.113835:0:3239:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 577 MB/s 00000001:01000000:0.0:1789122943.363903:0:3239:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 831 MB/s 00000001:01000000:2.0F:1789122943.613794:0:3239:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 6263 MB/s 00000020:02000000:2.0:1789122944.329149:0:3271:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_138_g7946b16 00000400:02000000:1.0:1789122945.021151:0:3286:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.206.130@tcp [8/256/0/180] 00008000:02000000:3.0:1789122948.366488:0:3436:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1789122988.791360:0:5235:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789122997.638386:0:5820:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789122997.638392:0:5820:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789122997.638521:0:5820:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000ca2054e3 00000080:02000400:3.0:1789122997.638533:0:5820:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1789122997.644783:0:5820:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1789122997.644796:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789122997.644833:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000054b23b05) 00000020:00000080:3.0:1789122997.644852:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789122997.679255:0:5820:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789122997.682858:0:5820:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789122997.720589:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789122997.720630:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789122997.720977:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789122997.721029:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789122997.721052:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789122997.721509:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789122997.721517:0:5820:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789122997.721526:0:5820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7e1648d68fc917ca 00000020:01000004:3.0:1789122997.721532:0:5820:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789122997.721537:0:5820:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789122997.721541:0:5820:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ca2054e3 from MGS 00000020:01000004:3.0:1789122997.721544:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789122997.721553:0:5820:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000016f32823) 00000020:00000080:3.0:1789122997.721562:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789122997.721609:0:5820:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ca2054e3 from MGS, refs=2 00080000:01000000:3.0:1789122997.721614:0:5820:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789122997.721620:0:5820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7e1648d68fc917d8 00000100:00100000:3.0:1789122997.721742:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789122997.721868:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789122997.721874:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789122997.722259:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789122997.722270:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789122997.723139:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789122997.723275:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789122997.723279:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789122997.735438:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789122997.735456:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789122997.736009:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789122997.736015:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789122997.737052:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789122997.737056:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789122997.737058:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789122997.737320:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789122997.737323:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789122997.737324:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789122997.738858:0:5820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789122997.741845:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1789122997.988731:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2567 MB/s 00000001:01000000:2.0:1789122998.238864:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2655 MB/s 00000001:01000000:2.0:1789122998.490729:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 392 MB/s 00000001:01000000:1.0:1789122998.741174:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 387 MB/s 00080000:10000000:1.0:1789122998.762152:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:1.0:1789122998.789798:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789122998.794364:0:5820:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789122998.794390:0:5820:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789122998.794392:0:5820:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1789122998.802172:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789122998.803897:0:5820:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789122998.803955:0:5820:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1789122998.804198:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789122998.804235:0:5820:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789122998.807154:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789122998.807324:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789122998.807330:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789122998.808221:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789122998.808229:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789122998.810267:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789122998.810281:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789122998.813539:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789122998.813571:0:5820:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.130@tcp' 00000020:01000004:0.0:1789122998.813573:0:5820:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789122998.813624:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.130@tcp (typ=mgc) 00000020:00000080:0.0:1789122998.813675:0:5820:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.130@tcp (00000000be8d558f) 00000020:00000080:0.0:1789122998.813690:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789122998.813800:0:5820:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000add7692a@MGC192.168.206.130@tcp: add connection 192.168.206.130@tcp at head 00010000:00010000:0.0:1789122998.813951:0:5820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.130@tcp-0 is initialized 00000040:01000000:0.0:1789122998.813957:0:5820:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.130@tcp ctxt 1 is initialized 00000100:00080000:1.0:1789122998.815367:0:5836:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789122998.821751:0:5838:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789122998.821926:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.130@tcp (uuid dd41f4a0-f4e3-41a1-856e-0c34af912023) 00000020:00000080:0.0:1789122998.821946:0:5820:0:(genops.c:1385:class_connect()) connect: client dd41f4a0-f4e3-41a1-856e-0c34af912023, cookie 0x7e1648d68fc917e6 00000100:00080000:0.0:1789122998.821957:0:5820:0:(import.c:510:import_select_connection()) MGC192.168.206.130@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789122998.821962:0:5820:0:(import.c:624:import_select_connection()) MGC192.168.206.130@tcp: import 00000000add7692a using connection 192.168.206.130@tcp/0@lo 00000100:00100000:0.0:1789122998.821990:0:5820:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000072df1ebc x1876031381176448/t0(0) o250->MGC192.168.206.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789122998.822018:0:5820:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import dd41f4a0-f4e3-41a1-856e-0c34af912023->MGS 00000020:01000004:0.0:1789122998.822038:0:5820:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789122998.822042:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789122998.822054:0:5820:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000027f90bc8) 00000020:00000080:0.0:1789122998.822065:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789122998.826655:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000072df1ebc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd41f4a0-f4e3-41a1-856e-0c34af912023:3301:1876031381176448:0@lo:250: 00000100:00100000:1.0:1789122998.826740:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789122998.826826:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381176448 00000100:00100000:1.0:1789122998.826833:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381176448 00000100:00100000:1.0:1789122998.826873:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789122998.826879:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006983f1e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3301:x1876031381176448:12345-0@lo:250: 00010000:00080000:1.0:1789122998.826902:0:5833:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from dd41f4a0-f4e3-41a1-856e-0c34af912023@0@lo t0 exp 0000000000000000 cur 113 last 0 00000020:00000080:1.0:1789122998.826937:0:5833:0:(genops.c:1385:class_connect()) connect: client dd41f4a0-f4e3-41a1-856e-0c34af912023, cookie 0x7e1648d68fc917f4 00000100:00080000:1.0:1789122998.827059:0:5833:0:(import.c:65:import_set_state_nolock()) 00000000d33716e0 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789122998.827106:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006983f1e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+5:3301:x1876031381176448:12345-0@lo:250: Request processed in 226us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789122998.827114:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789122998.827155:0:3301:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.130@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789122998.827163:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.130@tcp: connect to target with instance 0 00000100:00080000:1.0:1789122998.827175:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789122998.827180:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789122998.827183:0:3301:0:(import.c:65:import_set_state_nolock()) 00000000add7692a MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789122998.827186:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789122998.827194:0:3301:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789122998.827198:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000072df1ebc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd41f4a0-f4e3-41a1-856e-0c34af912023:3301:1876031381176448:0@lo:250: 00000100:00100000:0.0:1789122998.848578:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789122998.848828:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789122998.848834:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789122998.856241:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789122998.856259:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789122998.858479:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789122998.859075:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789122998.866239:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789122998.866438:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789122998.866444:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789122998.867199:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789122998.867206:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789122998.948985:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789122998.951356:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789122998.951367:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789122998.954722:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789122998.954808:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789122998.959790:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789122998.959955:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789122998.959960:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789122998.960598:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789122998.960604:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789122998.961077:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789122998.961214:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789122998.961225:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789122998.961716:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789122998.961722:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789122998.962136:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789122998.962261:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789122998.962265:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789122998.964355:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789122998.964366:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789122999.022298:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789122999.022551:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789122999.022557:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789122999.028279:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789122999.028293:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789122999.039850:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789122999.039868:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789122999.041470:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789122999.041492:0:5820:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1789122999.041498:0:5820:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789122999.041606:0:5820:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.130@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789122999.041673:0:5820:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.130@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1789122999.041681:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789122999.041682:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789122999.041683:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789122999.041684:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789122999.041685:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789122999.041686:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789122999.041687:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789122999.041689:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789122999.041690:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789122999.041691:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789122999.041692:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789122999.041693:0:5820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789122999.041695:0:5820:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1789122999.041697:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789122999.041698:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789122999.041699:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789122999.041700:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789122999.041701:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789122999.041702:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789122999.041703:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789122999.041703:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789122999.041704:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789122999.041705:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789122999.041706:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789122999.041707:0:5820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789122999.041730:0:5820:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789122999.041745:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001ba2c071 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381176576:0@lo:253: 00000100:00100000:2.0:1789122999.041807:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789122999.041847:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 0000000009305878 going to sleep for 11 seconds 00000100:00100000:0.0:1789122999.041923:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381176576 00000100:00100000:0.0:1789122999.041929:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381176576 00000100:00100000:0.0:1789122999.041975:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789122999.041983:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007cc92c67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+5:5820:x1876031381176576:12345-0@lo:253: 20000000:01000000:0.0:1789122999.042022:0:5835:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789122999.042025:0:5835:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1789122999.042502:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789122999.042788:0:5835:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1789122999.043110:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789122999.044525:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1789122999.045088:0:5835:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789122999.045092:0:5835:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1789122999.045097:0:5835:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1789122999.045100:0:5835:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1789122999.045112:0:5835:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1789122999.045300:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789122999.045509:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1789122999.045522:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789122999.045562:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1789122999.045602:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1789122999.045670:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1789122999.045749:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1789122999.045757:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1789122999.045799:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1789122999.045813:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1789122999.045848:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1789122999.045855:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1789122999.045884:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1789122999.045934:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1789122999.045968:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789122999.045972:0:5835:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1789122999.045985:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789122999.046179:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1789122999.046188:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789122999.046217:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1789122999.046243:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1789122999.046303:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1789122999.046315:0:5835:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1789122999.046387:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1789122999.046396:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789122999.046464:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1789122999.046501:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1789122999.046528:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1789122999.046537:0:5835:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1789122999.046606:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1789122999.046614:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1789122999.046660:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1789122999.046689:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1789122999.046807:0:5835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1789122999.046842:0:5835:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789122999.046849:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1789122999.050935:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1789122999.051281:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1789122999.051307:0:5835:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.130@tcp for mdt 20000000:01000000:2.0:1789122999.051309:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.130@tcp (null) (null) (null) 00000040:00080000:2.0:1789122999.051346:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1789122999.051355:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789122999.051386:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1789122999.051504:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.130@tcp (null) (null) 00000040:00080000:2.0:1789122999.051558:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1789122999.051569:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789122999.051597:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1789122999.051623:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1789122999.051912:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789122999.051915:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789122999.051919:0:5835:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789122999.051942:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789122999.051945:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789122999.051973:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789122999.051975:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789122999.054616:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1789122999.054918:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1789122999.054954:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1789122999.055011:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1789122999.055022:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789122999.055024:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789122999.055451:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1789122999.057909:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1789122999.057962:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1789122999.057996:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1789122999.058011:0:5835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789122999.058014:0:5835:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1789122999.058018:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789122999.058021:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789122999.058025:0:5835:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1789122999.058030:0:5835:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1789122999.058782:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1789122999.058936:0:5835:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1789122999.069111:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1789122999.069163:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1789122999.069238:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1789122999.069258:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789122999.069277:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000065590729/0x7e1648d68fc917fb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.069532:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000065590729/0x7e1648d68fc917fb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.069554:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000065590729/0x7e1648d68fc917fb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.069561:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000065590729/0x7e1648d68fc917fb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.069567:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000065590729/0x7e1648d68fc917fb lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.069573:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000065590729/0x7e1648d68fc917fb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.069579:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000065590729 already unused, calling callback (00000000de122ce6) 00010000:00010000:3.0:1789122999.069582:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000065590729/0x7e1648d68fc917fb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.069589:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000065590729/0x7e1648d68fc917fb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.069600:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000065590729/0x7e1648d68fc917fb lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.069607:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000065590729/0x7e1648d68fc917fb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.069612:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000065590729/0x7e1648d68fc917fb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789122999.069816:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789122999.280780:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007cc92c67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+5:5820:x1876031381176576:12345-0@lo:253: Request processed in 238791us (238965us total) trans 0 rc 0/0 00000100:00100000:0.0:1789122999.280793:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789122999.280936:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001ba2c071 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381176576:0@lo:253: 10000000:01000000:3.0:1789122999.280958:0:5820:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789122999.280962:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789122999.280963:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789122999.280965:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789122999.280966:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1789122999.280967:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789122999.280968:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789122999.280969:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789122999.280971:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789122999.280972:0:5820:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789122999.280973:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789122999.280975:0:5820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789122999.280991:0:5820:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ca2054e3 from lustre-MDT0000 10000000:01000000:3.0:1789122999.281015:0:5820:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789122999.281017:0:5820:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789122999.281020:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9f3407c54ed8 10000000:01000000:3.0:1789122999.281024:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789122999.281031:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f3407c54ed8 from 1 10000000:01000000:3.0:1789122999.281033:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789122999.281065:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: 0000000065590729/0x7e1648d68fc91802 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.281076:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: 0000000065590729/0x7e1648d68fc91802 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.281085:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: 0000000065590729/0x7e1648d68fc91802 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789122999.281101:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a918312 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381176704:0@lo:101: 00000100:00100000:3.0:1789122999.281162:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789122999.281451:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000015f7e2c going to sleep for 11 seconds 00000100:00100000:1.0:1789122999.281494:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381176704 00000100:00100000:1.0:1789122999.281500:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381176704 00000100:00100000:1.0:1789122999.281576:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789122999.281584:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000069cef55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+5:5820:x1876031381176704:12345-0@lo:101: 00010000:00010000:1.0:1789122999.281596:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789122999.281608:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d3f86d6e/0x7e1648d68fc91809 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91802 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789122999.281648:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d3f86d6e/0x7e1648d68fc91809 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91802 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789122999.281657:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d3f86d6e/0x7e1648d68fc91809 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91802 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789122999.281665:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d3f86d6e, rc 0) 00000100:00100000:1.0:1789122999.281702:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000069cef55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+6:5820:x1876031381176704:12345-0@lo:101: Request processed in 120us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789122999.281717:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789122999.281774:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a918312 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381176704:0@lo:101: 00010000:00010000:3.0:1789122999.281792:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: 0000000065590729/0x7e1648d68fc91802 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91809 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.281800:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: 0000000065590729/0x7e1648d68fc91802 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91809 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789122999.281842:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a918312 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381176832:0@lo:501: 00000100:00100000:3.0:1789122999.281866:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789122999.282001:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000015f7e2c going to sleep for 11 seconds 00000100:00100000:0.0:1789122999.282070:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381176832 00000100:00100000:0.0:1789122999.282075:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381176832 00000100:00100000:0.0:1789122999.282096:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789122999.282102:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b778469 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+6:5820:x1876031381176832:12345-0@lo:501: 00000100:00100000:3.0:1789122999.282402:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a918312 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381176832:0@lo:501: 10000000:01000000:3.0:1789122999.282439:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789122999.282450:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: 0000000065590729/0x7e1648d68fc91802 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91809 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.282457:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: 0000000065590729/0x7e1648d68fc91802 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91809 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789122999.282464:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f3408401800 10000000:01000000:3.0:1789122999.282468:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789122999.282471:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9f3408401800 10000000:01000000:3.0:1789122999.282473:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789122999.282475:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9f3408401800 from 1 10000000:01000000:3.0:1789122999.282477:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789122999.282490:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: 00000000d1543c31/0x7e1648d68fc91810 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.282495:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: 00000000d1543c31/0x7e1648d68fc91810 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.282512:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: 00000000d1543c31/0x7e1648d68fc91810 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789122999.282522:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a918312 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381176960:0@lo:101: 00000100:00100000:3.0:1789122999.282547:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789122999.282556:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000015f7e2c going to sleep for 11 seconds 00000100:00100000:0.0:1789122999.282669:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b778469 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+6:5820:x1876031381176832:12345-0@lo:501: Request processed in 202us (437us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789122999.282677:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789122999.282698:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381176960 00000100:00100000:0.0:1789122999.282701:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381176960 00000100:00100000:0.0:1789122999.282719:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789122999.282725:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc80e906 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+6:5820:x1876031381176960:12345-0@lo:101: 00010000:00010000:0.0:1789122999.282732:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789122999.282741:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000de28d7e6/0x7e1648d68fc91817 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91810 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789122999.282754:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000de28d7e6/0x7e1648d68fc91817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91810 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789122999.282761:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000de28d7e6/0x7e1648d68fc91817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91810 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789122999.282767:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000de28d7e6, rc 0) 00000100:00100000:0.0:1789122999.282803:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc80e906 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+7:5820:x1876031381176960:12345-0@lo:101: Request processed in 79us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789122999.282808:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789122999.282887:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a918312 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381176960:0@lo:101: 00010000:00010000:3.0:1789122999.282897:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: 00000000d1543c31/0x7e1648d68fc91810 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91817 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.282904:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: 00000000d1543c31/0x7e1648d68fc91810 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91817 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789122999.282914:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789122999.282917:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: 00000000d1543c31/0x7e1648d68fc91810 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91817 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.282922:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: 00000000d1543c31/0x7e1648d68fc91810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91817 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789122999.282928:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789122999.282931:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789122999.282935:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9f3408401800 10000000:01000000:3.0:1789122999.282937:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789122999.282940:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789122999.282941:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789122999.282953:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: 00000000af13bbaa/0x7e1648d68fc9181e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.282965:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: 00000000af13bbaa/0x7e1648d68fc9181e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.282971:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: 00000000af13bbaa/0x7e1648d68fc9181e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789122999.282982:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a918312 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381177088:0@lo:101: 00000100:00100000:3.0:1789122999.283006:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789122999.283033:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000015f7e2c going to sleep for 11 seconds 00000100:00100000:0.0:1789122999.283083:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381177088 00000100:00100000:0.0:1789122999.283087:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381177088 00000100:00100000:0.0:1789122999.283104:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789122999.283109:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055cacb4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+7:5820:x1876031381177088:12345-0@lo:101: 00010000:00010000:0.0:1789122999.283121:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789122999.283128:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008433c12f/0x7e1648d68fc91825 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc9181e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789122999.283140:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008433c12f/0x7e1648d68fc91825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc9181e expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789122999.283148:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008433c12f/0x7e1648d68fc91825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc9181e expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789122999.283153:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008433c12f, rc 0) 00000100:00100000:0.0:1789122999.283188:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055cacb4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+8:5820:x1876031381177088:12345-0@lo:101: Request processed in 79us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789122999.283194:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789122999.283261:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a918312 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381177088:0@lo:101: 00010000:00010000:3.0:1789122999.283270:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: 00000000af13bbaa/0x7e1648d68fc9181e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91825 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.283277:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: 00000000af13bbaa/0x7e1648d68fc9181e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91825 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789122999.283437:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a918312 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381177216:0@lo:501: 00000100:00100000:3.0:1789122999.283464:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789122999.283485:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000015f7e2c going to sleep for 11 seconds 00000100:00100000:0.0:1789122999.283542:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381177216 00000100:00100000:0.0:1789122999.283546:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381177216 00000100:00100000:0.0:1789122999.283563:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789122999.283567:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000046f9b6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+8:5820:x1876031381177216:12345-0@lo:501: 00000100:00100000:0.0:1789122999.283764:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000046f9b6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+9:5820:x1876031381177216:12345-0@lo:501: Request processed in 196us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789122999.283772:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789122999.283851:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a918312 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381177216:0@lo:501: 00000100:00100000:3.0:1789122999.283876:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a918312 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381177344:0@lo:503: 00000100:00100000:3.0:1789122999.283913:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789122999.283942:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000015f7e2c going to sleep for 11 seconds 00000100:00100000:0.0:1789122999.283996:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381177344 00000100:00100000:0.0:1789122999.284000:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381177344 00000100:00100000:0.0:1789122999.284018:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789122999.284023:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005eeac49f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+9:5820:x1876031381177344:12345-0@lo:503: 00000100:00100000:0.0:1789122999.284160:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005eeac49f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+9:5820:x1876031381177344:12345-0@lo:503: Request processed in 136us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789122999.284166:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789122999.284250:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a918312 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381177344:0@lo:503: 00000100:00100000:0.0:1789122999.284933:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000211de2da pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:5863:1876031381177472:0@lo:502: 00000100:00100000:0.0:1789122999.284974:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789122999.285004:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d0bbdb02 going to sleep for 11 seconds 00000100:00100000:2.0:1789122999.285059:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381177472 00000100:00100000:2.0:1789122999.285064:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381177472 00000100:00100000:1.0:1789122999.285162:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789122999.285169:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c1a3b98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+9:5863:x1876031381177472:12345-0@lo:502: 00000100:00100000:1.0:1789122999.285488:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c1a3b98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+9:5863:x1876031381177472:12345-0@lo:502: Request processed in 320us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789122999.285495:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789122999.285585:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000211de2da pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:5863:1876031381177472:0@lo:502: 00000020:01000000:0.0:1789122999.285607:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789122999.285618:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789122999.285620:0:5863:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789122999.285641:0:5863:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789122999.285645:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789122999.285658:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000373fe1ea) 00000020:00000080:0.0:1789122999.285671:0:5863:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789122999.285676:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789122999.285744:0:5863:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789122999.285751:0:5863:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7e1648d68fc91833 00000020:00000080:0.0:1789122999.285942:0:5863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789122999.285946:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789122999.285948:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789122999.285950:0:5863:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789122999.285952:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789122999.285955:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789122999.285956:0:5863:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789122999.285959:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789122999.285965:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000078ead92c) 00000020:00000080:0.0:1789122999.285974:0:5863:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789122999.285977:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789122999.285978:0:5863:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789122999.285980:0:5863:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789122999.285985:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789122999.286017:0:5863:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ca2054e3 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789122999.286033:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000f03838cb) 00000020:00000080:0.0:1789122999.286041:0:5863:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789122999.286091:0:5863:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789122999.286096:0:5863:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7e1648d68fc91848 00000020:00000080:0.0:1789122999.286184:0:5863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789122999.286190:0:5863:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789122999.286195:0:5863:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x7e1648d68fc9184f 00080000:01000000:0.0:1789122999.286200:0:5863:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789122999.286203:0:5863:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7e1648d68fc91856 00080000:10000000:0.0:1789122999.286761:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1789122999.286964:0:5863:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1789122999.290992:0:5863:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1789122999.368167:0:5863:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1789122999.368848:0:5863:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1789122999.371804:0:5863:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1789122999.372078:0:5863:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789122999.408717:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000009832cd17) 00000020:00000080:1.0:1789122999.408739:0:5863:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789122999.408806:0:5863:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789122999.408811:0:5863:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7e1648d68fc91864 00000020:00000080:1.0:1789122999.412340:0:5863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1789122999.413510:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789122999.449322:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789122999.496705:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789122999.557060:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789122999.606485:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789122999.645833:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1789122999.690891:0:5863:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x7e1648d68fc9186b 00000020:00000080:0.0:1789122999.691472:0:5863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789122999.691483:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789122999.691489:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789122999.691491:0:5863:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789122999.691494:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789122999.691498:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789122999.691499:0:5863:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789122999.691502:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789122999.691504:0:5863:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789122999.691506:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789122999.691508:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789122999.691509:0:5863:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789122999.691511:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789122999.691515:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789122999.691516:0:5863:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789122999.691520:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789122999.691552:0:5863:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1789122999.691607:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000211de2da pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:5863:1876031381177600:0@lo:502: 00000100:00100000:0.0:1789122999.691689:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789122999.691737:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set 000000004889c98a going to sleep for 11 seconds 00000100:00100000:2.0:1789122999.691958:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381177600 00000100:00100000:2.0:1789122999.691965:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381177600 00000100:00100000:2.0:1789122999.692021:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789122999.692029:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042a5adba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+9:5863:x1876031381177600:12345-0@lo:502: 00000100:00100000:2.0:1789122999.692621:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042a5adba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+9:5863:x1876031381177600:12345-0@lo:502: Request processed in 593us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789122999.692646:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789122999.692686:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000211de2da pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:5863:1876031381177600:0@lo:502: 00000020:01000000:0.0:1789122999.692716:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789122999.692720:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789122999.692722:0:5863:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1789122999.692725:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1789122999.692914:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1789122999.692934:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789122999.692985:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: 00000000af13bbaa/0x7e1648d68fc9181e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91825 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789122999.692999:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: 00000000af13bbaa/0x7e1648d68fc9181e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91825 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789122999.693007:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f3408401800 from 1 10000000:01000000:2.0:1789122999.693009:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789122999.693033:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: 00000000c55db965/0x7e1648d68fc91872 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789122999.693039:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: 00000000c55db965/0x7e1648d68fc91872 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789122999.693046:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: 00000000c55db965/0x7e1648d68fc91872 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789122999.693057:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d21195a pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381177728:0@lo:101: 00000100:00100000:2.0:1789122999.693085:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789122999.693116:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a612008a going to sleep for 11 seconds 00000100:00100000:0.0:1789122999.693164:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381177728 00000100:00100000:0.0:1789122999.693169:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381177728 00000100:00100000:0.0:1789122999.693200:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789122999.693207:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2bf2984 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+9:5820:x1876031381177728:12345-0@lo:101: 00010000:00010000:0.0:1789122999.693215:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789122999.693225:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cc8bab06/0x7e1648d68fc91879 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91872 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789122999.693242:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cc8bab06/0x7e1648d68fc91879 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91872 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789122999.693251:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cc8bab06/0x7e1648d68fc91879 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91872 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789122999.693258:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cc8bab06, rc 0) 00000100:00100000:0.0:1789122999.693285:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2bf2984 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+10:5820:x1876031381177728:12345-0@lo:101: Request processed in 79us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789122999.693306:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789122999.693435:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d21195a pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381177728:0@lo:101: 00010000:00010000:2.0:1789122999.693445:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: 00000000c55db965/0x7e1648d68fc91872 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91879 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789122999.693453:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: 00000000c55db965/0x7e1648d68fc91872 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91879 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789122999.694060:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d21195a pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381177856:0@lo:256: 00000100:00100000:2.0:1789122999.694098:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789122999.694130:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a612008a going to sleep for 11 seconds 00000100:00100000:0.0:1789122999.694186:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381177856 00000100:00100000:0.0:1789122999.694190:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381177856 00000100:00100000:0.0:1789122999.694217:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789122999.694222:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003bbd4ab7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+10:5820:x1876031381177856:12345-0@lo:256: 20000000:01000000:0.0:1789122999.694235:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789122999.694240:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789122999.694295:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003bbd4ab7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+10:5820:x1876031381177856:12345-0@lo:256: Request processed in 72us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789122999.694316:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789122999.694437:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d21195a pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381177856:0@lo:256: 10000000:01000000:2.0:1789122999.695047:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789122999.695226:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: 00000000c55db965/0x7e1648d68fc91872 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91879 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789122999.695236:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: 00000000c55db965/0x7e1648d68fc91872 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91879 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789122999.695244:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f3408401800 from 1 10000000:01000000:2.0:1789122999.695247:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789122999.695269:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: 00000000edbc550f/0x7e1648d68fc91880 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789122999.695276:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: 00000000edbc550f/0x7e1648d68fc91880 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789122999.695294:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: 00000000edbc550f/0x7e1648d68fc91880 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789122999.695313:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d21195a pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381177984:0@lo:101: 00000100:00100000:2.0:1789122999.695346:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789122999.695376:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a612008a going to sleep for 11 seconds 00000100:00100000:0.0:1789122999.695511:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381177984 00000100:00100000:0.0:1789122999.695516:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381177984 00000100:00100000:0.0:1789122999.695546:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789122999.695552:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb120b8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+10:5820:x1876031381177984:12345-0@lo:101: 00010000:00010000:0.0:1789122999.695560:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789122999.695570:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000075c337e2/0x7e1648d68fc91887 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91880 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789122999.695595:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000075c337e2/0x7e1648d68fc91887 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91880 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789122999.695602:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000075c337e2/0x7e1648d68fc91887 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91880 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789122999.695609:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000075c337e2, rc 0) 00000100:00100000:0.0:1789122999.695651:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb120b8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+11:5820:x1876031381177984:12345-0@lo:101: Request processed in 100us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789122999.695657:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789122999.695772:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d21195a pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381177984:0@lo:101: 00010000:00010000:2.0:1789122999.695782:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: 00000000edbc550f/0x7e1648d68fc91880 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91887 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789122999.695789:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: 00000000edbc550f/0x7e1648d68fc91880 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91887 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789122999.695838:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d21195a pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381178112:0@lo:501: 00000100:00100000:2.0:1789122999.695860:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789122999.695886:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a612008a going to sleep for 11 seconds 00000100:00100000:0.0:1789122999.695926:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381178112 00000100:00100000:0.0:1789122999.695930:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381178112 00000100:00100000:0.0:1789122999.695954:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789122999.695959:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f268ca6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+11:5820:x1876031381178112:12345-0@lo:501: 00000100:00100000:0.0:1789122999.696679:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f268ca6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+11:5820:x1876031381178112:12345-0@lo:501: Request processed in 718us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789122999.696688:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789122999.696745:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d21195a pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381178112:0@lo:501: 00000100:00100000:3.0:1789122999.696828:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d21195a pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381178240:0@lo:503: 00000100:00100000:3.0:1789122999.696987:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789122999.697019:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c93e763e going to sleep for 11 seconds 00000100:00100000:2.0:1789122999.697089:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381178240 00000100:00100000:2.0:1789122999.697094:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381178240 00000100:00100000:2.0:1789122999.697130:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789122999.697138:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096b38483 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+11:5820:x1876031381178240:12345-0@lo:503: 00000040:00080000:2.0:1789122999.697175:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789122999.697217:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096b38483 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+11:5820:x1876031381178240:12345-0@lo:503: Request processed in 80us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789122999.697224:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789122999.697513:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d21195a pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381178240:0@lo:503: 00000040:00080000:3.0:1789122999.699874:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789122999.700054:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789122999.700072:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789122999.700083:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: 00000000edbc550f/0x7e1648d68fc91880 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91887 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789122999.700094:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: 00000000edbc550f/0x7e1648d68fc91880 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91887 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789122999.700198:0:5820:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789122999.700201:0:5820:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f3408401800 10000000:01000000:2.0:1789122999.700203:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f3408401800 10000000:01000000:2.0:1789122999.700207:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789122999.700213:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f3408401800 from 1 10000000:01000000:2.0:1789122999.700216:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789122999.700245:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: 00000000532b9068/0x7e1648d68fc9188e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789122999.700263:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: 00000000532b9068/0x7e1648d68fc9188e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789122999.700273:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: 00000000532b9068/0x7e1648d68fc9188e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789122999.700414:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea13d917 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381178368:0@lo:101: 00000100:00100000:2.0:1789122999.700477:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789122999.700547:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 0000000031d93efc going to sleep for 11 seconds 00000100:00100000:0.0:1789122999.700716:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381178368 00000100:00100000:0.0:1789122999.700722:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381178368 00000100:00100000:0.0:1789122999.700809:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789122999.700818:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089618529 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+11:5820:x1876031381178368:12345-0@lo:101: 00010000:00010000:0.0:1789122999.700830:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789122999.700841:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ef12c789/0x7e1648d68fc91895 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc9188e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789122999.700861:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ef12c789/0x7e1648d68fc91895 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc9188e expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789122999.700870:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ef12c789/0x7e1648d68fc91895 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc9188e expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789122999.700879:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ef12c789, rc 0) 00000100:00100000:0.0:1789122999.700927:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089618529 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:5820:x1876031381178368:12345-0@lo:101: Request processed in 111us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789122999.700934:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789122999.700995:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea13d917 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381178368:0@lo:101: 00010000:00010000:3.0:1789122999.701010:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: 00000000532b9068/0x7e1648d68fc9188e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91895 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.701018:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: 00000000532b9068/0x7e1648d68fc9188e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91895 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789122999.701066:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a918312 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381178496:0@lo:501: 00000100:00100000:3.0:1789122999.701092:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789122999.701505:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 000000008a8ad9fe going to sleep for 11 seconds 00000100:00100000:2.0:1789122999.701557:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381178496 00000100:00100000:2.0:1789122999.701562:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381178496 00000100:00100000:2.0:1789122999.701602:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789122999.701609:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000630911c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:5820:x1876031381178496:12345-0@lo:501: 00000100:00100000:2.0:1789122999.701899:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000630911c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:5820:x1876031381178496:12345-0@lo:501: Request processed in 291us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1789122999.701907:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789122999.701909:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a918312 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381178496:0@lo:501: 00000100:00100000:3.0:1789122999.701937:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a918312 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381178624:0@lo:503: 00000100:00100000:3.0:1789122999.701974:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789122999.702041:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 000000008a8ad9fe going to sleep for 11 seconds 00000100:00100000:1.0:1789122999.702066:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381178624 00000100:00100000:1.0:1789122999.702070:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381178624 00000100:00100000:1.0:1789122999.702127:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789122999.702133:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000acdea81b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:5820:x1876031381178624:12345-0@lo:503: 00000100:00100000:1.0:1789122999.702616:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000acdea81b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:5820:x1876031381178624:12345-0@lo:503: Request processed in 483us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789122999.702729:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a918312 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381178624:0@lo:503: 00000100:00100000:1.0:1789122999.702817:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789122999.703210:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a918312 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:5868:1876031381178752:0@lo:502: 00000100:00100000:3.0:1789122999.703376:0:5868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789122999.703418:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set 000000000285cffc going to sleep for 11 seconds 00000100:00100000:2.0:1789122999.703431:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381178752 00000100:00100000:2.0:1789122999.703437:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381178752 00000100:00100000:2.0:1789122999.703503:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789122999.703511:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003dd97d3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:5868:x1876031381178752:12345-0@lo:502: 00000100:00100000:2.0:1789122999.703751:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003dd97d3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:5868:x1876031381178752:12345-0@lo:502: Request processed in 241us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789122999.703758:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789122999.703767:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a918312 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:5868:1876031381178752:0@lo:502: 00000020:01000004:3.0:1789122999.703867:0:5868:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789122999.703880:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000c26b1895) 00000020:00000080:3.0:1789122999.703948:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1789122999.704009:0:5868:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ca2054e3 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789122999.704011:0:5868:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000ca2054e3 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789122999.704013:0:5868:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000ca2054e3 4 00010000:00080000:3.0:1789122999.704036:0:5868:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000919564f2@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.130@tcp at head 00010000:00010000:3.0:1789122999.707847:0:5868:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1789122999.708036:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789122999.708069:0:5868:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789122999.708081:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x7e1648d68fc918a3 00000100:00080000:3.0:1789122999.708089:0:5868:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789122999.708094:0:5868:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000919564f2 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:3.0:1789122999.708127:0:5868:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008a918312 x1876031381178880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789122999.708186:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a918312 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876031381178880:0@lo:38: 00000100:00100000:1.0:1789122999.708255:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789122999.708444:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381178880 00000100:00100000:2.0:1789122999.708451:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381178880 00000100:00100000:2.0:1789122999.708483:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789122999.708489:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005de7bda2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1876031381178880:12345-0@lo:38: 00000100:00080000:3.0:1789122999.708553:0:5868:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789122999.711734:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005de7bda2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1876031381178880:12345-0@lo:38: Request processed in 3236us (3472us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789122999.711747:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789122999.715015:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789122999.715028:0:3301:0:(import.c:65:import_set_state_nolock()) 00000000919564f2 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789122999.715036:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789122999.715039:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a918312 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876031381178880:0@lo:38: 00000100:00100000:3.0:1789122999.717268:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008da171cc pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:5868:1876031381179008:0@lo:502: 00000100:00100000:3.0:1789122999.717473:0:5868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789122999.717528:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f61e66a9 going to sleep for 11 seconds 00000100:00100000:0.0:1789122999.717614:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381179008 00000100:00100000:0.0:1789122999.717621:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381179008 00000100:00100000:0.0:1789122999.717696:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789122999.717704:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ee5e827 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:5868:x1876031381179008:12345-0@lo:502: 00000100:00100000:0.0:1789122999.717902:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ee5e827 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:5868:x1876031381179008:12345-0@lo:502: Request processed in 199us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789122999.717910:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789122999.718099:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008da171cc pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:5868:1876031381179008:0@lo:502: 00000040:00080000:3.0:1789122999.718126:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1789122999.719835:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789122999.719859:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789122999.719918:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: 00000000532b9068/0x7e1648d68fc9188e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91895 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789122999.719929:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: 00000000532b9068/0x7e1648d68fc9188e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91895 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789122999.719988:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789122999.719990:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789122999.719991:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789122999.719992:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789122999.719993:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789122999.719995:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789122999.719996:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789122999.719997:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789122999.719998:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789122999.720000:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789122999.720001:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789122999.720002:0:5820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789122999.720005:0:5820:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789122999.720007:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789122999.720008:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789122999.720010:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789122999.720010:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789122999.720012:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789122999.720013:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789122999.720013:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789122999.720015:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789122999.720015:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789122999.720016:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789122999.720017:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789122999.720018:0:5820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789122999.720040:0:5820:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789122999.720053:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000211de2da pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381179136:0@lo:253: 00000100:00100000:0.0:1789122999.720107:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789122999.720146:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f199e3a1 going to sleep for 11 seconds 00000100:00100000:2.0:1789122999.721621:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381179136 00000100:00100000:2.0:1789122999.721657:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381179136 00000100:00100000:2.0:1789122999.721715:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789122999.721723:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd17ee81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:5820:x1876031381179136:12345-0@lo:253: 20000000:01000000:2.0:1789122999.721755:0:5833:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789122999.721767:0:5833:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789122999.771969:0:5833:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789122999.771989:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789122999.772209:0:5856:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789122999.772214:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789122999.772235:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003d9e59f6/0x7e1648d68fc918aa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789122999.772253:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cc8bab06/0x7e1648d68fc91879 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91872 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789122999.772261:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003d9e59f6/0x7e1648d68fc918aa lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789122999.772297:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cc8bab06/0x7e1648d68fc91879 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc91872 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789122999.772311:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cc8bab06/0x7e1648d68fc91879 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc91872 expref: 12 pid: 5835 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789122999.772324:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001e6a8dde pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1876031381179264:0@lo:104: 00000100:00100000:2.0:1789122999.772385:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789122999.772553:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381179264 00000100:00100000:1.0:1789122999.772560:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381179264 00000100:00100000:2.0:1789122999.772601:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set 000000001d495ee8 going to sleep for 11 seconds 00000100:00100000:3.0:1789122999.779848:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789122999.779865:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea13d917 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:5856:x1876031381179264:12345-0@lo:104: 00010000:00010000:3.0:1789122999.779884:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: 00000000c55db965/0x7e1648d68fc91872 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91879 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.779974:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789122999.779979:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea13d917 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:5856:x1876031381179264:12345-0@lo:104: Request processed in 120us (7596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789122999.779999:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789122999.780297:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001e6a8dde pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1876031381179264:0@lo:104: 00010000:00010000:1.0:1789122999.780327:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003d9e59f6/0x7e1648d68fc918aa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.784426:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789122999.784436:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: 00000000c55db965/0x7e1648d68fc91872 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91879 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.784449:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c55db965 already unused, calling callback (00000000e6d25f85) 10000000:00010000:3.0:1789122999.784453:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: 00000000c55db965/0x7e1648d68fc91872 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc91879 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.784461:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: 00000000c55db965/0x7e1648d68fc91872 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc91879 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789122999.784467:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: 00000000c55db965/0x7e1648d68fc91872 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc91879 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789122999.784472:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789122999.784522:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: 00000000c55db965/0x7e1648d68fc91872 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91879 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.784529:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789122999.784562:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: 00000000c55db965/0x7e1648d68fc91872 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91879 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.784569:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: 00000000c55db965/0x7e1648d68fc91872 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91879 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.784585:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789122999.784587:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789122999.784589:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789122999.784673:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789122999.784701:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008da171cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381179392:0@lo:103: 00000100:00100000:3.0:1789122999.784761:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789122999.784890:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381179392 00000100:00100000:1.0:1789122999.784898:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381179392 00010000:00010000:1.0:1789122999.784934:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cc8bab06/0x7e1648d68fc91879 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91872 expref: 13 pid: 5835 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789122999.784973:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789122999.784981:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d461c572 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:3302:x1876031381179392:12345-0@lo:103: 00010000:00010000:1.0:1789122999.784994:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789122999.784999:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cc8bab06/0x7e1648d68fc91879 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91872 expref: 13 pid: 5835 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789122999.785008:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cc8bab06/0x7e1648d68fc91879 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc91872 expref: 13 pid: 5835 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789122999.785025:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cc8bab06/0x7e1648d68fc91879 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc91872 expref: 13 pid: 5835 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789122999.785044:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003d9e59f6/0x7e1648d68fc918aa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789122999.785051:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003d9e59f6/0x7e1648d68fc918aa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789122999.785066:0:5824:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012851513s 00010000:00010000:1.0:1789122999.785069:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003d9e59f6/0x7e1648d68fc918aa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789122999.785075:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003d9e59f6/0x7e1648d68fc918aa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789122999.785080:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003d9e59f6/0x7e1648d68fc918aa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789122999.785085:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003d9e59f6/0x7e1648d68fc918aa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789122999.785090:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003d9e59f6 already unused, calling callback (00000000de122ce6) 00010000:00010000:1.0:1789122999.785093:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003d9e59f6/0x7e1648d68fc918aa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789122999.785099:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003d9e59f6/0x7e1648d68fc918aa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789122999.785119:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003d9e59f6/0x7e1648d68fc918aa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789122999.785130:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789122999.785174:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d461c572 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:3302:x1876031381179392:12345-0@lo:103: Request processed in 195us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789122999.785182:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789122999.788057:0:5856:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003d9e59f6/0x7e1648d68fc918aa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.788076:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003d9e59f6/0x7e1648d68fc918aa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789122999.788083:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003d9e59f6/0x7e1648d68fc918aa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789122999.788142:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008da171cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381179392:0@lo:103: 00000100:00100000:0.0:1789122999.796580:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd17ee81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+11:5820:x1876031381179136:12345-0@lo:253: Request processed in 74851us (76466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789122999.796595:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789122999.796792:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000211de2da pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:5820:1876031381179136:0@lo:253: 10000000:01000000:3.0:1789122999.796807:0:5820:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789122999.796810:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789122999.796811:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789122999.796813:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789122999.796814:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789122999.796815:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789122999.796816:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789122999.796818:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789122999.796819:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789122999.796820:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789122999.796822:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789122999.796823:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789122999.796824:0:5820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789122999.796925:0:5820:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789122999.805850:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789122999.806240:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789122999.806459:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789122999.808121:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789122999.808361:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789122999.809072:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1789122999.811230:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1789122999.811419:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1789122999.811667:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1789122999.811845:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1789122999.812037:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1789122999.812209:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00010000:00010000:3.0:1789122999.812865:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:3.0:1789122999.842998:0:5820:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1789122999.863770:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1789122999.864091:0:5873:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1789122999.864095:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1789122999.864540:0:5874:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789122999.874598:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789122999.874958:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789122999.875583:0:5820:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789122999.875593:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789122999.876009:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789122999.876998:0:5820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789122999.877547:0:5820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789122999.877578:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789122999.877818:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789122999.878005:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1789122999.879659:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1789122999.879810:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1789122999.879941:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789122999.880110:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1789122999.880250:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789122999.880578:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1789122999.880805:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1789122999.880974:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1789122999.881128:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1789122999.881283:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1789122999.881521:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789122999.881861:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1789122999.882014:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1789122999.882252:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1789122999.882540:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789122999.882778:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1789122999.883074:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1789122999.883226:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1789122999.883495:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1789122999.883722:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1789122999.883857:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789122999.884021:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1789122999.884200:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789122999.884428:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1789122999.884579:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789122999.884820:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789122999.884955:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789122999.885103:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789122999.885232:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789122999.885539:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1789122999.885874:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1789122999.886024:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1789122999.886220:0:5820:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1789122999.905969:0:5874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1789122999.958287:0:5820:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789122999.958322:0:5820:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffba00c18d7988 00100000:10000000:1.0:1789122999.958330:0:5820:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789122999.960143:0:5820:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789122999.960156:0:5820:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.130@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789122999.960170:0:5820:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789122999.960183:0:5820:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1789122999.961992:0:5874:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789122999.962053:0:5874:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789122999.962057:0:5874:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1789123000.839950:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123001.861806:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123002.886365:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123003.909043:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789123004.059058:0:6116:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1789123004.932822:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789123004.932829:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789123004.932832:0:38:0:(import.c:65:import_set_state_nolock()) 00000000919564f2 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789123004.932843:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000919564f2 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:3.0:1789123004.932866:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005ba443ed x1876031381179648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789123004.933870:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008da171cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381179520:0@lo:400: 00000100:00100000:0.0:1789123004.933937:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123004.934140:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381179520 00000100:00100000:2.0:1789123004.934148:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381179520 00010000:00010000:3.0:1789123004.934163:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123004.934171:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ba443ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876031381179648:0@lo:38: 00000100:00100000:2.0:1789123004.934195:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789123004.934205:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5493437 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+11:3304:x1876031381179520:12345-0@lo:400: 00000100:00100000:1.0:1789123004.934213:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123004.934263:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381179648 00000100:00100000:2.0:1789123004.934268:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5493437 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+11:3304:x1876031381179520:12345-0@lo:400: Request processed in 65us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123004.934269:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381179648 00000100:00100000:2.0:1789123004.934280:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789123004.934294:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789123004.934300:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c87c3c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1876031381179648:12345-0@lo:38: 00010000:00080000:1.0:1789123004.934321:0:5842:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 119 last 0 00000100:00100000:2.0:1789123004.934328:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008da171cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381179520:0@lo:400: 00000020:00000080:1.0:1789123004.934360:0:5842:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x7e1648d68fc918b1 00000004:00100000:1.0:1789123004.934411:0:5842:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789123004.934513:0:5842:0:(import.c:65:import_set_state_nolock()) 0000000030b2254b : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789123004.934560:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c87c3c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876031381179648:12345-0@lo:38: Request processed in 260us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123004.934567:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789123004.934681:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005ba443ed x1876031381179648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789123014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789123004.934695:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789123004.934701:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789123004.934706:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789123004.934708:0:3301:0:(import.c:65:import_set_state_nolock()) 00000000919564f2 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789123004.934712:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ba443ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876031381179648:0@lo:38: 00010000:00010000:0.0:1789123005.956849:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789123005.956873:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789123005.956878:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f3408401800 from 3 10000000:01000000:1.0:1789123005.956883:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789123005.956926:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: 00000000bb2d80c5/0x7e1648d68fc918b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123005.956938:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: 00000000bb2d80c5/0x7e1648d68fc918b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123005.956948:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: 00000000bb2d80c5/0x7e1648d68fc918b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123005.956969:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004065daf7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381179776:0@lo:101: 00000100:00100000:1.0:1789123005.957033:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123005.957088:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a61b196c going to sleep for 11 seconds 00000100:00100000:0.0:1789123005.957464:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381179776 00000100:00100000:0.0:1789123005.957471:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381179776 00000100:00100000:0.0:1789123005.957516:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789123005.957524:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010e902c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+11:5838:x1876031381179776:12345-0@lo:101: 00010000:00010000:0.0:1789123005.957538:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123005.957549:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f7882119/0x7e1648d68fc918bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc918b8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123005.957571:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f7882119/0x7e1648d68fc918bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc918b8 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123005.957580:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f7882119/0x7e1648d68fc918bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc918b8 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123005.957590:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f7882119, rc 0) 00000100:00100000:0.0:1789123005.958051:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010e902c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:5838:x1876031381179776:12345-0@lo:101: Request processed in 527us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123005.958059:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789123005.958342:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004065daf7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381179776:0@lo:101: 00010000:00010000:1.0:1789123005.958361:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: 00000000bb2d80c5/0x7e1648d68fc918b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc918bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123005.958370:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: 00000000bb2d80c5/0x7e1648d68fc918b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc918bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123005.958435:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004065daf7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381179904:0@lo:256: 00000100:00100000:1.0:1789123005.958472:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123005.958509:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a61b196c going to sleep for 11 seconds 00000100:00100000:3.0:1789123005.958901:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381179904 00000100:00100000:3.0:1789123005.958907:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381179904 00000100:00100000:3.0:1789123005.958947:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789123005.958954:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc30df7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:5838:x1876031381179904:12345-0@lo:256: 20000000:01000000:3.0:1789123005.958970:0:5834:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789123005.958984:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789123005.958988:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1789123005.959077:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc30df7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:5838:x1876031381179904:12345-0@lo:256: Request processed in 124us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123005.959084:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789123005.959160:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004065daf7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381179904:0@lo:256: 10000000:01000000:1.0:1789123005.959204:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789123005.959210:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: 00000000bb2d80c5/0x7e1648d68fc918b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc918bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123005.959217:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: 00000000bb2d80c5/0x7e1648d68fc918b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc918bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123006.981998:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123008.005767:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789123008.395278:0:6319:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc7067dfb0 20000000:00000080:2.0:1789123008.395295:0:6319:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f341004fc00 uarg=0000000000000000 20000000:01000000:2.0:1789123008.395326:0:6319:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789123008.395338:0:6319:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789123008.395343:0:6319:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789123008.395555:0:6319:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1789123008.395566:0:6319:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1789123008.403676:0:6319:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789123008.403951:0:6319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789123008.404008:0:6319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1789123008.404056:0:6319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1789123008.404071:0:6319:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789123008.404085:0:6319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000fd1b9f24/0x7e1648d68fc918c6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123008.404101:0:6319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000075c337e2/0x7e1648d68fc91887 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91880 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123008.404107:0:6319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000fd1b9f24/0x7e1648d68fc918c6 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123008.404140:0:6319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000075c337e2/0x7e1648d68fc91887 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc91880 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123008.404155:0:6319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000075c337e2/0x7e1648d68fc91887 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc91880 expref: 11 pid: 5834 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123008.404167:0:6319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004da186d2 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6319:1876031381180032:0@lo:104: 00000100:00100000:2.0:1789123008.404225:0:6319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123008.404290:0:6319:0:(client.c:2715:ptlrpc_set_wait()) set 000000002c6bffa6 going to sleep for 11 seconds 00000100:00100000:3.0:1789123008.404956:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381180032 00000100:00100000:3.0:1789123008.404964:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381180032 00000100:00100000:3.0:1789123008.405011:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789123008.405019:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0ac15ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:6319:x1876031381180032:12345-0@lo:104: 00010000:00010000:3.0:1789123008.405031:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: 00000000edbc550f/0x7e1648d68fc91880 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91887 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123008.405118:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789123008.405123:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0ac15ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:6319:x1876031381180032:12345-0@lo:104: Request processed in 107us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123008.405140:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789123008.405204:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789123008.405210:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: 00000000edbc550f/0x7e1648d68fc91880 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91887 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123008.405217:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000edbc550f already unused, calling callback (00000000e6d25f85) 10000000:00010000:0.0:1789123008.405220:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: 00000000edbc550f/0x7e1648d68fc91880 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc91887 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123008.405227:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: 00000000edbc550f/0x7e1648d68fc91880 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc91887 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789123008.405233:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: 00000000edbc550f/0x7e1648d68fc91880 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc91887 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789123008.405238:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789123008.405283:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: 00000000edbc550f/0x7e1648d68fc91880 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91887 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123008.405289:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789123008.405306:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: 00000000edbc550f/0x7e1648d68fc91880 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91887 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123008.405311:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: 00000000edbc550f/0x7e1648d68fc91880 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91887 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123008.405329:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123008.405331:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123008.405332:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123008.405343:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000160718f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381180160:0@lo:103: 00000100:00100000:0.0:1789123008.405386:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123008.405432:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381180160 00000100:00100000:0.0:1789123008.405442:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381180160 00010000:00010000:0.0:1789123008.405458:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000075c337e2/0x7e1648d68fc91887 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91880 expref: 12 pid: 5834 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123008.405480:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789123008.405486:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003371fa60 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:3305:x1876031381180160:12345-0@lo:103: 00010000:00010000:0.0:1789123008.405495:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123008.405500:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000075c337e2/0x7e1648d68fc91887 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91880 expref: 12 pid: 5834 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123008.405508:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000075c337e2/0x7e1648d68fc91887 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc91880 expref: 12 pid: 5834 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123008.405523:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000fd1b9f24/0x7e1648d68fc918c6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123008.405529:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fd1b9f24/0x7e1648d68fc918c6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123008.405541:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fd1b9f24/0x7e1648d68fc918c6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123008.405547:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fd1b9f24/0x7e1648d68fc918c6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123008.405552:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000fd1b9f24/0x7e1648d68fc918c6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123008.405557:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000fd1b9f24/0x7e1648d68fc918c6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123008.405562:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fd1b9f24 already unused, calling callback (00000000de122ce6) 00010000:00010000:0.0:1789123008.405571:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000fd1b9f24/0x7e1648d68fc918c6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123008.405577:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000fd1b9f24/0x7e1648d68fc918c6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123008.405585:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000fd1b9f24/0x7e1648d68fc918c6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123008.405593:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123008.405621:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003371fa60 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:3305:x1876031381180160:12345-0@lo:103: Request processed in 136us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123008.405649:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789123008.405683:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000160718f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381180160:0@lo:103: 00010000:00010000:1.0:1789123008.405853:0:6319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000075c337e2/0x7e1648d68fc91887 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc91880 expref: 11 pid: 5834 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123008.405864:0:6319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004da186d2 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6319:1876031381180032:0@lo:104: 00010000:00010000:1.0:1789123008.405876:0:6319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000fd1b9f24/0x7e1648d68fc918c6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123008.405883:0:6319:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000fd1b9f24/0x7e1648d68fc918c6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123008.405888:0:6319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000fd1b9f24/0x7e1648d68fc918c6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123008.405898:0:6319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fd1b9f24/0x7e1648d68fc918c6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123009.028999:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123010.053038:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123010.055270:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d77c5e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381180288:0@lo:400: 00000100:00100000:2.0:1789123010.055277:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ec088f5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876031381180416:0@lo:400: 00000100:00100000:3.0:1789123010.055333:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123010.055333:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123010.055400:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381180288 00000100:00100000:0.0:1789123010.055407:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381180288 00000100:00100000:0.0:1789123010.055460:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789123010.055463:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381180416 00000100:00100000:1.0:1789123010.055467:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381180416 00000100:00100000:0.0:1789123010.055468:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000330124c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+11:3302:x1876031381180288:12345-0@lo:400: 00000100:00100000:1.0:1789123010.055544:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789123010.055552:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013673649 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876031381180416:12345-0@lo:400: 00000100:00100000:0.0:1789123010.061430:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000330124c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+11:3302:x1876031381180288:12345-0@lo:400: Request processed in 5956us (6091us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123010.061445:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789123010.061781:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d77c5e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381180288:0@lo:400: 00010000:00080000:0.0:1789123010.068551:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ec088f5b x1876031381180416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123010.068571:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ec088f5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876031381180416:0@lo:400: 00000100:00100000:1.0:1789123010.069508:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013673649 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876031381180416:12345-0@lo:400: Request processed in 12947us (13165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123010.069521:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789123011.076759:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123012.102051:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123013.125767:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789123014.087279:0:6682:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789123014.087283:0:6682:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789123014.087429:0:6682:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000047882846 00000020:01000004:2.0:1789123014.087450:0:6682:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789123014.087461:0:6682:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789123014.087483:0:6682:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000f027728e) 00000020:00000080:2.0:1789123014.087499:0:6682:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789123014.122148:0:6682:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789123014.129895:0:6682:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 10000000:01000000:3.0:1789123014.148711:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789123014.148716:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f3408401800 from 1 10000000:01000000:3.0:1789123014.148720:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789123014.148736:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123014.148769:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: 00000000a799fe24/0x7e1648d68fc918d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.148781:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: 00000000a799fe24/0x7e1648d68fc918d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.148790:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: 00000000a799fe24/0x7e1648d68fc918d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123014.148811:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008f25018f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381180544:0@lo:101: 00000100:00100000:3.0:1789123014.148872:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123014.148934:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 000000008367d12f going to sleep for 11 seconds 00000100:00100000:1.0:1789123014.149054:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381180544 00000100:00100000:1.0:1789123014.149070:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381180544 00000100:00100000:1.0:1789123014.149118:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789123014.149125:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d74f027 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+11:5838:x1876031381180544:12345-0@lo:101: 00010000:00010000:1.0:1789123014.149137:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123014.149149:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001a715caf/0x7e1648d68fc918db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc918d4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123014.149168:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001a715caf/0x7e1648d68fc918db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc918d4 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123014.149176:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001a715caf/0x7e1648d68fc918db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc918d4 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123014.149183:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001a715caf, rc 0) 00000100:00100000:1.0:1789123014.149231:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d74f027 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:5838:x1876031381180544:12345-0@lo:101: Request processed in 98us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123014.149245:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789123014.149378:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008f25018f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381180544:0@lo:101: 00010000:00010000:0.0:1789123014.149398:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: 00000000a799fe24/0x7e1648d68fc918d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc918db expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123014.149406:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: 00000000a799fe24/0x7e1648d68fc918d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc918db expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123014.149469:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000160718f9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381180672:0@lo:501: 00000100:00100000:0.0:1789123014.149497:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123014.149526:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 000000002a39f657 going to sleep for 11 seconds 00000100:00100000:3.0:1789123014.149604:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381180672 00000100:00100000:3.0:1789123014.149609:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381180672 00000100:00100000:3.0:1789123014.149659:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789123014.149665:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bfb0136f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:5838:x1876031381180672:12345-0@lo:501: 00000100:00100000:3.0:1789123014.150092:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bfb0136f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:5838:x1876031381180672:12345-0@lo:501: Request processed in 426us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123014.150100:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789123014.150200:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000160718f9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381180672:0@lo:501: 00000100:00100000:0.0:1789123014.150229:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000160718f9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381180800:0@lo:503: 00000100:00100000:0.0:1789123014.150266:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123014.150296:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 000000002a39f657 going to sleep for 11 seconds 00000100:00100000:3.0:1789123014.150608:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381180800 00000100:00100000:3.0:1789123014.150615:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381180800 00000100:00100000:3.0:1789123014.150666:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789123014.150673:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb8ac17e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:5838:x1876031381180800:12345-0@lo:503: 00000100:00100000:3.0:1789123014.151031:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb8ac17e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:5838:x1876031381180800:12345-0@lo:503: Request processed in 359us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123014.151039:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789123014.151136:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000160718f9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381180800:0@lo:503: 00000100:00100000:1.0:1789123014.151759:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003753d21b pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:6684:1876031381180928:0@lo:502: 00000100:00100000:1.0:1789123014.151802:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123014.151838:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set 0000000053b3845d going to sleep for 11 seconds 00000100:00100000:0.0:1789123014.152369:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381180928 00000100:00100000:0.0:1789123014.152376:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381180928 00000100:00100000:0.0:1789123014.152415:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789123014.152422:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2dc24d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:6684:x1876031381180928:12345-0@lo:502: 00000100:00100000:0.0:1789123014.152652:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2dc24d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:6684:x1876031381180928:12345-0@lo:502: Request processed in 230us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123014.152660:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789123014.152672:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003753d21b pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:6684:1876031381180928:0@lo:502: 00000020:01000000:1.0:1789123014.152697:0:6684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789123014.152706:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789123014.152708:0:6684:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789123014.152715:0:6684:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f3408401800 00000020:00000080:1.0:1789123014.152718:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789123014.152820:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d4a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:6684:1876031381181056:0@lo:502: 00000100:00100000:1.0:1789123014.152861:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123014.152883:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381181056 00000100:00100000:1.0:1789123014.152885:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3405d2c600 going to sleep for 11 seconds 00000100:00100000:3.0:1789123014.152887:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381181056 00000100:00100000:3.0:1789123014.152917:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789123014.152924:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:6684:x1876031381181056:12345-0@lo:502: 00000100:00100000:3.0:1789123014.153046:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:6684:x1876031381181056:12345-0@lo:502: Request processed in 122us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123014.153053:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789123014.153078:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d4a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:6684:1876031381181056:0@lo:502: 00000020:01000000:1.0:1789123014.153095:0:6684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789123014.153100:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789123014.153101:0:6684:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789123014.153104:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789123014.153732:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789123014.153820:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789123014.153831:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401514000/0x7e1648d68fc918d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc918db expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.153840:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f3401514000/0x7e1648d68fc918d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc918db expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00100000:10000000:2.0:1789123014.179276:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789123014.185448:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789123014.185484:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789123014.185543:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789123014.185571:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789123014.185914:0:6682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789123014.185933:0:6682:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789123014.185943:0:6682:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7e1648d68fc918e2 00000020:01000004:3.0:1789123014.185950:0:6682:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789123014.185967:0:6682:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.130@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789123014.185969:0:6682:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789123014.185974:0:6682:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789123014.185978:0:6682:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789123014.185987:0:6682:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9f3407beb490) 00000020:00000080:3.0:1789123014.185997:0:6682:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1789123014.194973:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789123014.199020:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789123014.199030:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789123014.206135:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789123014.206153:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789123014.216302:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789123014.216335:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789123014.218925:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789123014.219107:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789123014.219113:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789123014.222336:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789123014.222361:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789123014.282556:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789123014.282928:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789123014.282935:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789123014.286968:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789123014.286985:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789123014.289442:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789123014.289622:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789123014.294052:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789123014.294266:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789123014.294274:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789123014.295015:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789123014.295022:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789123014.354155:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789123014.354695:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789123014.354702:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789123014.356076:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789123014.356088:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789123014.357217:0:6682:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789123014.357316:0:6682:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789123014.357323:0:6682:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.130@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789123014.398145:0:6682:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.130@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789123014.398184:0:6682:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.130@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1789123014.398193:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789123014.398194:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789123014.398195:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789123014.398197:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789123014.398198:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789123014.398199:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789123014.398200:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789123014.398202:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789123014.398203:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789123014.398205:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789123014.398206:0:6682:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789123014.398210:0:6682:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1789123014.398212:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789123014.398213:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789123014.398214:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789123014.398215:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789123014.398216:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789123014.398217:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789123014.398218:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789123014.398219:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789123014.398220:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789123014.398221:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789123014.398222:0:6682:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789123014.398246:0:6682:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789123014.398263:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d54780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381181184:0@lo:253: 00000100:00100000:3.0:1789123014.398491:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123014.398600:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408d2c540 going to sleep for 11 seconds 00000100:00100000:0.0:1789123014.398803:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381181184 00000100:00100000:0.0:1789123014.398826:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381181184 00000100:00100000:0.0:1789123014.398906:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789123014.398916:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:6682:x1876031381181184:12345-0@lo:253: 20000000:01000000:0.0:1789123014.399574:0:5833:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789123014.399580:0:5833:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1789123014.399585:0:5833:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1789123014.399588:0:5833:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1789123014.400478:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789123014.400678:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1789123014.400691:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1789123014.400730:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1789123014.400737:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1789123014.400769:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1789123014.400811:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1789123014.401152:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1789123014.401171:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.130@tcp 20000000:01000000:0.0:1789123014.401173:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.130@tcp (null) (null) (null) 00000040:00080000:0.0:1789123014.401209:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1789123014.401217:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789123014.401277:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1789123014.401287:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.130@tcp (null) (null) 00000040:00080000:0.0:1789123014.401323:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1789123014.401346:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789123014.401379:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1789123014.401424:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1789123014.410745:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1789123014.410778:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.130@tcp 20000000:01000000:0.0:1789123014.410780:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.130@tcp (null) (null) (null) 00000040:00080000:0.0:1789123014.410819:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1789123014.410827:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789123014.410882:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1789123014.410897:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.130@tcp (null) (null) 00000040:00080000:0.0:1789123014.410968:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1789123014.410979:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789123014.411013:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1789123014.411049:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1789123014.411065:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789123014.411069:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789123014.411072:0:5833:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789123014.411084:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789123014.411086:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789123014.411117:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789123014.411119:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789123014.413160:0:6698:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1789123014.413238:0:6698:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1789123014.413299:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1789123014.414040:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1789123014.414087:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1789123014.414151:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1789123014.414164:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789123014.414166:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789123014.417822:0:6699:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1789123014.417909:0:6699:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1789123014.417957:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1789123014.418301:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1789123014.419617:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1789123014.419830:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1789123014.419850:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789123014.419853:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789123014.420617:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1789123014.425865:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1789123014.425923:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1789123014.425998:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1789123014.426017:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1789123014.426019:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1789123014.426028:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789123014.426045:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f34029f3e00/0x7e1648d68fc918f0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123014.426063:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f34421d9800/0x7e1648d68fc91809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91802 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123014.426071:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f3400030e00/0x7e1648d68fc91825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc9181e expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123014.426077:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f3400030200/0x7e1648d68fc91895 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc9188e expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123014.426100:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f34029f3e00/0x7e1648d68fc918f0 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123014.426135:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f3400030200/0x7e1648d68fc91895 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc9188e expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123014.426149:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f3400030200/0x7e1648d68fc91895 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc9188e expref: 12 pid: 5835 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123014.426162:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c983c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1876031381181312:0@lo:104: 00000100:00100000:2.0:1789123014.426220:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123014.426371:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381181312 00000100:00100000:3.0:1789123014.426378:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381181312 00000100:00100000:3.0:1789123014.426420:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789123014.426429:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409c9a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:5833:x1876031381181312:12345-0@lo:104: 00010000:00010000:3.0:1789123014.426441:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f34029f3200/0x7e1648d68fc9188e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91895 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.426499:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789123014.426505:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409c9a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:5833:x1876031381181312:12345-0@lo:104: Request processed in 78us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123014.426512:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789123014.426531:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789123014.426536:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f34029f3200/0x7e1648d68fc9188e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91895 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.426543:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34029f3200 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:3.0:1789123014.426547:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f34029f3200/0x7e1648d68fc9188e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc91895 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.426555:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f34029f3200/0x7e1648d68fc9188e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc91895 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789123014.426562:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f34029f3200/0x7e1648d68fc9188e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc91895 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789123014.426568:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789123014.426595:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f34029f3200/0x7e1648d68fc9188e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91895 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.426601:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789123014.426616:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f34029f3200/0x7e1648d68fc9188e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91895 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.426622:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f34029f3200/0x7e1648d68fc9188e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91895 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.426663:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123014.426664:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123014.426666:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123014.427452:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f3400030e00/0x7e1648d68fc91825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc9181e expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123014.427465:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f3400030e00/0x7e1648d68fc91825 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc9181e expref: 12 pid: 5833 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123014.427476:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c99680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1876031381181568:0@lo:104: 00000100:00100000:2.0:1789123014.427515:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123014.427581:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381181568 00000100:00100000:3.0:1789123014.427586:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381181568 00000100:00100000:3.0:1789123014.427614:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789123014.427621:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409c98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:5833:x1876031381181568:12345-0@lo:104: 00010000:00010000:3.0:1789123014.427652:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc9181e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91825 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.427692:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789123014.427698:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409c98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:5833:x1876031381181568:12345-0@lo:104: Request processed in 78us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123014.427705:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789123014.428503:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381181440:0@lo:103: 00000100:00100000:0.0:1789123014.428545:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123014.428612:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381181440 00000100:00100000:3.0:1789123014.428617:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381181440 00010000:00010000:3.0:1789123014.428662:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f3400030200/0x7e1648d68fc91895 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc9188e expref: 13 pid: 5835 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123014.428689:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789123014.428696:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:3304:x1876031381181440:12345-0@lo:103: 00010000:00010000:3.0:1789123014.428708:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123014.428713:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f3400030200/0x7e1648d68fc91895 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc9188e expref: 13 pid: 5835 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.428723:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f3400030200/0x7e1648d68fc91895 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc9188e expref: 13 pid: 5835 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.428756:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789123014.428783:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:3304:x1876031381181440:12345-0@lo:103: Request processed in 87us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123014.428789:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789123014.429592:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789123014.429601:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc9181e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91825 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123014.429609:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401514a00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:1.0:1789123014.429613:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc9181e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc91825 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123014.429621:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc9181e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc91825 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789123014.429657:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc9181e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc91825 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789123014.429663:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789123014.429698:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc9181e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91825 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123014.429705:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789123014.429715:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc9181e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91825 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123014.429722:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc9181e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91825 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123014.429737:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123014.429739:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123014.429741:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123014.429753:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381181696:0@lo:103: 00000100:00100000:1.0:1789123014.429791:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123014.432595:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381181696 00000100:00100000:3.0:1789123014.432611:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381181696 00010000:00010000:3.0:1789123014.432677:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f3400030e00/0x7e1648d68fc91825 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc9181e expref: 13 pid: 5833 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123014.432717:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789123014.432727:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d4a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:3305:x1876031381181696:12345-0@lo:103: 00010000:00010000:3.0:1789123014.432742:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123014.432748:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f3400030e00/0x7e1648d68fc91825 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc9181e expref: 13 pid: 5833 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.432761:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f3400030e00/0x7e1648d68fc91825 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc9181e expref: 13 pid: 5833 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.432782:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789123014.432852:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d4a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:3305:x1876031381181696:12345-0@lo:103: Request processed in 126us (3060us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123014.432859:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789123014.433284:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f34421d9800/0x7e1648d68fc91809 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc91802 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123014.433298:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f34421d9800/0x7e1648d68fc91809 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc91802 expref: 12 pid: 5834 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123014.433321:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c9a1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1876031381181824:0@lo:104: 00000100:00100000:2.0:1789123014.433376:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123014.433405:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3407fa3480 going to sleep for 11 seconds 00010000:00010000:2.0:1789123014.433425:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3400030200/0x7e1648d68fc91895 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc9188e expref: 12 pid: 5835 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123014.433448:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c983c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1876031381181312:0@lo:104: 00010000:00010000:2.0:1789123014.433462:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3400030e00/0x7e1648d68fc91825 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc9181e expref: 11 pid: 5833 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123014.433470:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c99680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1876031381181568:0@lo:104: 00000100:00100000:3.0:1789123014.433520:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381181824 00000100:00100000:3.0:1789123014.433525:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381181824 00000100:00100000:3.0:1789123014.433562:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789123014.433570:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409c98f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:5833:x1876031381181824:12345-0@lo:104: 00010000:00010000:3.0:1789123014.433582:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f3401514e00/0x7e1648d68fc91802 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91809 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.433658:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789123014.433664:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409c98f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:5833:x1876031381181824:12345-0@lo:104: Request processed in 95us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123014.433671:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789123014.433688:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789123014.433694:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f3401514e00/0x7e1648d68fc91802 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91809 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.433702:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401514e00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:3.0:1789123014.433706:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f3401514e00/0x7e1648d68fc91802 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc91809 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.433714:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f3401514e00/0x7e1648d68fc91802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc91809 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789123014.433720:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f3401514e00/0x7e1648d68fc91802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc91809 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789123014.433726:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789123014.433753:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f3401514e00/0x7e1648d68fc91802 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91809 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.433760:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789123014.433782:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f3401514e00/0x7e1648d68fc91802 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91809 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.433789:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f3401514e00/0x7e1648d68fc91802 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91809 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.433816:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123014.433818:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123014.433820:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123014.433831:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d57c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381181952:0@lo:103: 00000100:00100000:3.0:1789123014.433857:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123014.433895:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381181952 00000100:00100000:3.0:1789123014.433899:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381181952 00010000:00010000:3.0:1789123014.433914:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f34421d9800/0x7e1648d68fc91809 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91802 expref: 11 pid: 5834 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123014.433932:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789123014.433938:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d56d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+11:3302:x1876031381181952:12345-0@lo:103: 00010000:00010000:3.0:1789123014.433946:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123014.433950:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f34421d9800/0x7e1648d68fc91809 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91802 expref: 11 pid: 5834 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.433959:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f34421d9800/0x7e1648d68fc91809 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc91802 expref: 11 pid: 5834 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.433973:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f34029f3e00/0x7e1648d68fc918f0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.433980:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f34029f3e00/0x7e1648d68fc918f0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.433993:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f34029f3e00/0x7e1648d68fc918f0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.434000:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f34029f3e00/0x7e1648d68fc918f0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.434013:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f34029f3e00/0x7e1648d68fc918f0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.434020:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f34029f3e00/0x7e1648d68fc918f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.434026:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34029f3e00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:3.0:1789123014.434029:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f34029f3e00/0x7e1648d68fc918f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.434037:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f34029f3e00/0x7e1648d68fc918f0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.434046:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f34029f3e00/0x7e1648d68fc918f0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.434055:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789123014.434081:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d56d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+11:3302:x1876031381181952:12345-0@lo:103: Request processed in 143us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123014.434088:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789123014.434111:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d57c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381181952:0@lo:103: 00010000:00010000:2.0:1789123014.434490:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f34421d9800/0x7e1648d68fc91809 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc91802 expref: 10 pid: 5834 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123014.434502:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c9a1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1876031381181824:0@lo:104: 00010000:00010000:2.0:1789123014.434520:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f34029f3e00/0x7e1648d68fc918f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123014.434529:0:5833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f34029f3e00/0x7e1648d68fc918f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123014.434535:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f34029f3e00/0x7e1648d68fc918f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123014.434540:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f34029f3e00/0x7e1648d68fc918f0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789123014.434554:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789123014.436507:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381181440:0@lo:103: 00000100:00100000:1.0:1789123014.438662:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381181696:0@lo:103: 00000100:00100000:3.0:1789123014.492321:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+9:6682:x1876031381181184:12345-0@lo:253: Request processed in 93390us (93814us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123014.492344:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789123014.492532:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d54780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381181184:0@lo:253: 10000000:01000000:1.0:1789123014.492547:0:6682:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789123014.492550:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789123014.492552:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789123014.492553:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789123014.492554:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1789123014.492556:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789123014.492557:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789123014.492558:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789123014.492560:0:6682:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789123014.492561:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789123014.492563:0:6682:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789123014.492581:0:6682:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f343be04000 from lustre-OST0000 10000000:01000000:1.0:1789123014.492605:0:6682:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789123014.492608:0:6682:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789123014.492615:0:6682:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f3407c54ed8 local copy 10000000:01000000:1.0:1789123014.492618:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789123014.492668:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34421d9c00/0x7e1648d68fc918f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123014.492679:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.130@tcp lock: ffff9f34421d9c00/0x7e1648d68fc918f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123014.492688:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f34421d9c00/0x7e1648d68fc918f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123014.492706:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d4a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381182080:0@lo:101: 00000100:00100000:1.0:1789123014.492742:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123014.492794:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34365bdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789123014.492852:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381182080 00000100:00100000:0.0:1789123014.492858:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381182080 00000100:00100000:0.0:1789123014.492893:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789123014.492902:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+9:6682:x1876031381182080:12345-0@lo:101: 00010000:00010000:0.0:1789123014.492914:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123014.492927:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3400031400/0x7e1648d68fc918fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc918f7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123014.492948:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3400031400/0x7e1648d68fc918fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc918f7 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123014.492958:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3400031400/0x7e1648d68fc918fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc918f7 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123014.492967:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3400031400, rc 0) 00000100:00100000:0.0:1789123014.493021:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+10:6682:x1876031381182080:12345-0@lo:101: Request processed in 120us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123014.493028:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789123014.493162:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d4a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381182080:0@lo:101: 00010000:00010000:1.0:1789123014.493174:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f34421d9c00/0x7e1648d68fc918f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x7e1648d68fc918fe expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123014.493189:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f34421d9c00/0x7e1648d68fc918f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7e1648d68fc918fe expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123014.493286:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d4a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381182208:0@lo:501: 00000100:00100000:1.0:1789123014.493323:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123014.493618:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34365bdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789123014.493833:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381182208 00000100:00100000:0.0:1789123014.493838:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381182208 00000100:00100000:0.0:1789123014.493904:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789123014.493912:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+10:6682:x1876031381182208:12345-0@lo:501: 00000100:00100000:0.0:1789123014.494118:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+10:6682:x1876031381182208:12345-0@lo:501: Request processed in 206us (793us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789123014.494126:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789123014.494202:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d4a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381182208:0@lo:501: 10000000:01000000:2.0:1789123014.494279:0:6682:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789123014.494321:0:6682:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789123014.494336:0:6682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34421d9c00/0x7e1648d68fc918f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7e1648d68fc918fe expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123014.494456:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34421d9c00/0x7e1648d68fc918f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7e1648d68fc918fe expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123014.494464:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9f34421d9c00/0x7e1648d68fc918f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7e1648d68fc918fe expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123014.494488:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789123014.494505:0:6682:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f343be04000 10000000:01000000:2.0:1789123014.494510:0:6682:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789123014.494515:0:6682:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9f3407c54ed8 10000000:01000000:2.0:1789123014.494518:0:6682:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789123014.494521:0:6682:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9f3407c54ed8 from 1 10000000:01000000:2.0:1789123014.494523:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789123014.494545:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34029f3e00/0x7e1648d68fc91905 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123014.494553:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f34029f3e00/0x7e1648d68fc91905 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123014.494562:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f34029f3e00/0x7e1648d68fc91905 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123014.494576:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c9a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381182336:0@lo:101: 00000100:00100000:2.0:1789123014.494605:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123014.494649:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3407fa3a80 going to sleep for 11 seconds 00010000:00010000:0.0:1789123014.494702:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789123014.494708:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f34421d9c00/0x7e1648d68fc918f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x7e1648d68fc918fe expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123014.494715:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34421d9c00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:0.0:1789123014.494719:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f34421d9c00/0x7e1648d68fc918f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x7e1648d68fc918fe expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123014.494727:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f34421d9c00/0x7e1648d68fc918f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x7e1648d68fc918fe expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789123014.494734:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f34421d9c00/0x7e1648d68fc918f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x7e1648d68fc918fe expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789123014.494740:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789123014.494759:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f34421d9c00/0x7e1648d68fc918f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x7e1648d68fc918fe expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123014.494766:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789123014.494792:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f34421d9c00/0x7e1648d68fc918f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x7e1648d68fc918fe expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123014.494807:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f34421d9c00/0x7e1648d68fc918f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x7e1648d68fc918fe expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123014.494822:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123014.494823:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123014.494825:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123014.494834:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789123014.494845:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381182464:0@lo:103: 00000100:00100000:0.0:1789123014.494874:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123014.494907:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381182464 00000100:00100000:0.0:1789123014.494911:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381182464 00000100:00100000:0.0:1789123014.494944:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789123014.494951:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+10:3302:x1876031381182464:12345-0@lo:103: 00010000:00010000:0.0:1789123014.494960:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123014.494972:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3400031400/0x7e1648d68fc918fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7e1648d68fc918f7 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123014.494986:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123014.495016:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+9:3302:x1876031381182464:12345-0@lo:103: Request processed in 65us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123014.495023:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789123014.495052:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381182464:0@lo:103: 00000100:00100000:0.0:1789123014.495071:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381182336 00000100:00100000:0.0:1789123014.495074:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381182336 00000100:00100000:0.0:1789123014.495089:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789123014.495094:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+9:6682:x1876031381182336:12345-0@lo:101: 00010000:00010000:0.0:1789123014.495111:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123014.495121:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3400030e00/0x7e1648d68fc9190c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91905 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123014.495138:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3400030e00/0x7e1648d68fc9190c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91905 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123014.495147:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3400030e00/0x7e1648d68fc9190c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91905 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123014.495153:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3400030e00, rc 0) 00000100:00100000:0.0:1789123014.495183:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+10:6682:x1876031381182336:12345-0@lo:101: Request processed in 88us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123014.495188:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789123014.495213:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c9a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381182336:0@lo:101: 00010000:00010000:0.0:1789123014.495461:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f34029f3e00/0x7e1648d68fc91905 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc9190c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123014.495470:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f34029f3e00/0x7e1648d68fc91905 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc9190c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789123014.495487:0:6682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789123014.495497:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34029f3e00/0x7e1648d68fc91905 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc9190c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123014.495504:0:6682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f34029f3e00/0x7e1648d68fc91905 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc9190c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789123014.495511:0:6682:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789123014.495521:0:6682:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789123014.495526:0:6682:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789123014.495528:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789123014.495544:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3400030200/0x7e1648d68fc91913 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123014.495552:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f3400030200/0x7e1648d68fc91913 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123014.495559:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f3400030200/0x7e1648d68fc91913 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123014.495571:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381182592:0@lo:101: 00000100:00100000:0.0:1789123014.495600:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123014.495612:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34184e6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789123014.495662:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381182592 00000100:00100000:0.0:1789123014.495666:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381182592 00000100:00100000:0.0:1789123014.495683:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789123014.495689:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+10:6682:x1876031381182592:12345-0@lo:101: 00010000:00010000:0.0:1789123014.495697:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123014.495705:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3400031c00/0x7e1648d68fc9191a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91913 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123014.495719:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3400031c00/0x7e1648d68fc9191a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91913 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123014.495727:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3400031c00/0x7e1648d68fc9191a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91913 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123014.495734:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3400031c00, rc 0) 00000100:00100000:0.0:1789123014.495772:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+11:6682:x1876031381182592:12345-0@lo:101: Request processed in 83us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123014.495778:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789123014.495803:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381182592:0@lo:101: 00010000:00010000:0.0:1789123014.495812:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f3400030200/0x7e1648d68fc91913 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc9191a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123014.495819:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f3400030200/0x7e1648d68fc91913 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc9191a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123014.495897:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381182720:0@lo:501: 00000100:00100000:0.0:1789123014.495922:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123014.495936:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34184e6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789123014.495953:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381182720 00000100:00100000:0.0:1789123014.495957:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381182720 00000100:00100000:0.0:1789123014.495974:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789123014.495980:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+11:6682:x1876031381182720:12345-0@lo:501: 00000100:00100000:0.0:1789123014.496167:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+11:6682:x1876031381182720:12345-0@lo:501: Request processed in 187us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123014.496174:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789123014.496198:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381182720:0@lo:501: 00000100:00100000:0.0:1789123014.496588:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381182848:0@lo:503: 00000100:00100000:0.0:1789123014.496739:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123014.496764:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34184e6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789123014.496813:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381182848 00000100:00100000:3.0:1789123014.496818:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381182848 00000100:00100000:3.0:1789123014.496850:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789123014.496857:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+11:6682:x1876031381182848:12345-0@lo:503: 00000100:00100000:3.0:1789123014.497091:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+11:6682:x1876031381182848:12345-0@lo:503: Request processed in 233us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123014.497098:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789123014.497188:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381182848:0@lo:503: 00000040:00080000:0.0:1789123014.497977:0:6682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789123014.498062:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381182976:0@lo:502: 00000100:00100000:0.0:1789123014.498111:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123014.498187:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34184e6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789123014.498282:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381182976 00000100:00100000:1.0:1789123014.498289:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381182976 00000100:00100000:1.0:1789123014.498489:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789123014.498499:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+11:6682:x1876031381182976:12345-0@lo:502: 00000100:00100000:1.0:1789123014.498687:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+11:6682:x1876031381182976:12345-0@lo:502: Request processed in 190us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123014.498695:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789123014.498785:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381182976:0@lo:502: 00000040:00080000:0.0:1789123014.499034:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789123014.499081:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789123014.499119:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789123014.499182:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789123014.499238:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789123014.499275:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789123014.499303:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381183104:0@lo:502: 00000100:00100000:0.0:1789123014.499486:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123014.499755:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34184e6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789123014.499824:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381183104 00000100:00100000:3.0:1789123014.499830:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381183104 00000100:00100000:3.0:1789123014.499861:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789123014.499869:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+11:6682:x1876031381183104:12345-0@lo:502: 00000100:00100000:3.0:1789123014.500051:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+11:6682:x1876031381183104:12345-0@lo:502: Request processed in 183us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123014.500058:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789123014.500131:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381183104:0@lo:502: 00000040:00080000:0.0:1789123014.500276:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789123014.500288:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1789123014.501153:0:6701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789123014.501162:0:6701:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789123014.501168:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123014.501170:0:6701:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789123014.501177:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789123014.501200:0:6701:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9f343bd01a48) 00000020:00000080:3.0:1789123014.501231:0:6701:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789123014.501239:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789123014.501322:0:6701:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f343be04000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789123014.501339:0:6701:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789123014.501345:0:6701:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7e1648d68fc91928 00010000:00010000:3.0:1789123014.505564:0:6701:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1789123014.505995:0:6701:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1789123014.509196:0:6701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789123014.509580:0:6701:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1789123014.517882:0:6701:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789123014.518981:0:6701:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1789123014.521582:0:6701:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789123014.521594:0:6701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789123014.521606:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789123014.521608:0:6701:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789123014.521613:0:6701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789123014.521617:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789123014.521618:0:6701:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789123014.521621:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789123014.521623:0:6701:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789123014.521841:0:6701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789123014.521845:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789123014.521847:0:6701:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789123014.521850:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789123014.521987:0:6682:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1789123014.522012:0:6682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789123014.522036:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3400030200/0x7e1648d68fc91913 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc9191a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123014.522049:0:6682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f3400030200/0x7e1648d68fc91913 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc9191a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789123014.522058:0:6682:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f343be04000 from 1 10000000:01000000:0.0:1789123014.522060:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789123014.522092:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3400031400/0x7e1648d68fc9192f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123014.522111:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f3400031400/0x7e1648d68fc9192f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123014.522123:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f3400031400/0x7e1648d68fc9192f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123014.522144:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381183232:0@lo:101: 00000100:00100000:0.0:1789123014.522204:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123014.522264:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34184e6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789123014.522467:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381183232 00000100:00100000:2.0:1789123014.522474:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381183232 00000100:00100000:2.0:1789123014.522516:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789123014.522525:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+11:6682:x1876031381183232:12345-0@lo:101: 00010000:00010000:2.0:1789123014.522538:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123014.522551:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f34029f3200/0x7e1648d68fc91936 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc9192f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123014.522573:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f34029f3200/0x7e1648d68fc91936 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc9192f expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123014.522582:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f34029f3200/0x7e1648d68fc91936 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc9192f expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123014.522590:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f34029f3200, rc 0) 00000100:00100000:2.0:1789123014.522659:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:6682:x1876031381183232:12345-0@lo:101: Request processed in 135us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123014.522665:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789123014.522743:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381183232:0@lo:101: 00010000:00010000:1.0:1789123014.522757:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f3400031400/0x7e1648d68fc9192f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91936 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123014.522766:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f3400031400/0x7e1648d68fc9192f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91936 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123014.522846:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d4b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381183360:0@lo:501: 00000100:00100000:1.0:1789123014.522874:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123014.522903:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34365bdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789123014.522950:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381183360 00000100:00100000:2.0:1789123014.522954:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381183360 00000100:00100000:2.0:1789123014.522989:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789123014.522995:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:6682:x1876031381183360:12345-0@lo:501: 00000100:00100000:2.0:1789123014.523188:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:6682:x1876031381183360:12345-0@lo:501: Request processed in 192us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123014.523196:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789123014.523335:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d4b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381183360:0@lo:501: 00000100:00100000:1.0:1789123014.523364:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d4b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381183488:0@lo:503: 00000100:00100000:1.0:1789123014.523409:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123014.523430:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34365bdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789123014.523530:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381183488 00000100:00100000:2.0:1789123014.523535:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381183488 00000100:00100000:2.0:1789123014.523557:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789123014.523563:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:6682:x1876031381183488:12345-0@lo:503: 00000100:00100000:2.0:1789123014.523717:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:6682:x1876031381183488:12345-0@lo:503: Request processed in 152us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123014.523724:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789123014.523840:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d4b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381183488:0@lo:503: 00000040:00080000:1.0:1789123014.524054:0:6682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789123014.524124:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d4b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381183616:0@lo:502: 00000100:00100000:1.0:1789123014.524159:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123014.524188:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3419687a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789123014.524588:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381183616 00000100:00100000:2.0:1789123014.524593:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381183616 00000100:00100000:2.0:1789123014.524652:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789123014.524660:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:6682:x1876031381183616:12345-0@lo:502: 00000100:00100000:2.0:1789123014.525067:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:6682:x1876031381183616:12345-0@lo:502: Request processed in 406us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123014.525075:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789123014.525158:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d4b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381183616:0@lo:502: 00000040:00080000:1.0:1789123014.525550:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789123014.525602:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789123014.525766:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d4b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381183744:0@lo:502: 00000100:00100000:0.0:1789123014.532614:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123014.532709:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34365bdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789123014.532734:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381183744 00000100:00100000:0.0:1789123014.532741:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381183744 00000100:00100000:0.0:1789123014.532781:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789123014.532791:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:6682:x1876031381183744:12345-0@lo:502: 00000100:00100000:0.0:1789123014.533843:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:6682:x1876031381183744:12345-0@lo:502: Request processed in 1049us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123014.533854:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789123014.533947:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d4b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381183744:0@lo:502: 00000040:00080000:1.0:1789123014.534097:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789123014.534112:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789123014.535835:0:6705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789123014.535846:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789123014.535849:0:6705:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789123014.535855:0:6705:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f343be04000 00000020:00000080:1.0:1789123014.535856:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789123014.535874:0:6705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789123014.535877:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789123014.535878:0:6705:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789123014.535880:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789123014.535987:0:6682:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789123014.536005:0:6682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789123014.536025:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3400031400/0x7e1648d68fc9192f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91936 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.536047:0:6682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f3400031400/0x7e1648d68fc9192f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91936 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789123014.536082:0:6682:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789123014.536085:0:6682:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f343be04000 10000000:01000000:3.0:1789123014.536088:0:6682:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f343be04000 10000000:01000000:3.0:1789123014.536092:0:6682:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789123014.536096:0:6682:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f343be04000 from 1 10000000:01000000:3.0:1789123014.536099:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789123014.536129:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401514e00/0x7e1648d68fc9193d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.536137:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f3401514e00/0x7e1648d68fc9193d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.536146:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f3401514e00/0x7e1648d68fc9193d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123014.536167:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d57c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381183872:0@lo:101: 00000100:00100000:3.0:1789123014.536230:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123014.536271:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34365a63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789123014.536610:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381183872 00000100:00100000:2.0:1789123014.536617:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381183872 00000100:00100000:2.0:1789123014.536685:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789123014.536695:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:6682:x1876031381183872:12345-0@lo:101: 00010000:00010000:2.0:1789123014.536707:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123014.536720:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f34029f3600/0x7e1648d68fc91944 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc9193d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123014.536743:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f34029f3600/0x7e1648d68fc91944 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc9193d expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123014.536762:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f34029f3600/0x7e1648d68fc91944 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc9193d expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123014.536771:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f34029f3600, rc 0) 00000100:00100000:2.0:1789123014.536809:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:6682:x1876031381183872:12345-0@lo:101: Request processed in 115us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123014.536816:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789123014.537616:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d57c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381183872:0@lo:101: 00010000:00010000:3.0:1789123014.537656:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f3401514e00/0x7e1648d68fc9193d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91944 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.537666:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f3401514e00/0x7e1648d68fc9193d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91944 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123014.537780:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d57c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381184000:0@lo:501: 00000100:00100000:3.0:1789123014.537814:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123014.537845:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34365a63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123014.537908:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381184000 00000100:00100000:1.0:1789123014.537913:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381184000 00000100:00100000:1.0:1789123014.537944:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789123014.537952:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:6682:x1876031381184000:12345-0@lo:501: 00000100:00100000:1.0:1789123014.538155:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:6682:x1876031381184000:12345-0@lo:501: Request processed in 204us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123014.538169:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789123014.538304:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d57c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381184000:0@lo:501: 00000100:00100000:3.0:1789123014.538457:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d57c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381184128:0@lo:503: 00000100:00100000:3.0:1789123014.538497:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123014.538520:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34365a63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123014.538563:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381184128 00000100:00100000:1.0:1789123014.538567:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381184128 00000100:00100000:1.0:1789123014.538600:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789123014.538607:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:6682:x1876031381184128:12345-0@lo:503: 00000100:00100000:1.0:1789123014.538772:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:6682:x1876031381184128:12345-0@lo:503: Request processed in 165us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123014.538779:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789123014.538825:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d57c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381184128:0@lo:503: 00000040:00080000:1.0:1789123014.539069:0:6682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789123014.539123:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d4b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381184256:0@lo:502: 00000100:00100000:1.0:1789123014.539158:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123014.539175:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3403b106c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123014.539190:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381184256 00000100:00100000:1.0:1789123014.539193:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381184256 00000100:00100000:1.0:1789123014.539212:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789123014.539286:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:6682:x1876031381184256:12345-0@lo:502: 00000100:00100000:1.0:1789123014.539531:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:6682:x1876031381184256:12345-0@lo:502: Request processed in 312us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123014.539538:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789123014.539671:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d4b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381184256:0@lo:502: 00000040:00080000:3.0:1789123014.539913:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789123014.539975:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789123014.540012:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789123014.540071:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789123014.540112:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789123014.540162:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789123014.540200:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789123014.540498:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789123014.540551:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789123014.541030:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789123014.541071:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789123014.541142:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789123014.541182:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789123014.541230:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789123014.541284:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789123014.541426:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789123014.541466:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789123014.541533:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789123014.541572:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789123014.541620:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789123014.541703:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789123014.541742:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789123014.541777:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789123014.541826:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789123014.541865:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1789123014.541899:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1789123014.541946:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1789123014.541986:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1789123014.542030:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d57840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381184384:0@lo:502: 00000100:00100000:3.0:1789123014.542099:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123014.542142:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34365a6780 going to sleep for 11 seconds 00000100:00100000:1.0:1789123014.542303:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381184384 00000100:00100000:1.0:1789123014.542319:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381184384 00000100:00100000:1.0:1789123014.542425:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789123014.542435:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:6682:x1876031381184384:12345-0@lo:502: 00000100:00100000:1.0:1789123014.542621:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:6682:x1876031381184384:12345-0@lo:502: Request processed in 187us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123014.542661:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789123014.542879:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d57840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381184384:0@lo:502: 00000040:00080000:0.0:1789123014.542952:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1789123014.542962:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789123014.543525:0:6706:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789123014.543539:0:6706:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9f342d8ab490) 00000020:00000080:0.0:1789123014.543558:0:6706:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1789123014.543666:0:6706:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f343be04000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789123014.543671:0:6706:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f343be04000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789123014.543674:0:6706:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f343be04000 3 00010000:00080000:0.0:1789123014.543706:0:6706:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f3301317800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.130@tcp at head 00010000:00010000:1.0:1789123014.545994:0:6706:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1789123014.546214:0:6706:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789123014.546261:0:6706:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789123014.546272:0:6706:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x7e1648d68fc91952 00000100:00080000:1.0:1789123014.546280:0:6706:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789123014.546286:0:6706:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f3301317800 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:1.0:1789123014.546333:0:6706:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f3409d49e00 x1876031381184512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789123014.546358:0:6706:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789123014.546571:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1876031381184512:0@lo:38: 00000100:00100000:3.0:1789123014.546656:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123014.546799:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381184512 00000100:00100000:1.0:1789123014.546805:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381184512 00000100:00100000:1.0:1789123014.546837:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789123014.546844:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3301:x1876031381184512:12345-0@lo:38: 00010000:00080000:1.0:1789123014.546865:0:5841:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 128 last 0 00000020:00000080:1.0:1789123014.546891:0:5841:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x7e1648d68fc91959 00000004:00100000:1.0:1789123014.546902:0:5841:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789123014.546927:0:5841:0:(import.c:65:import_set_state_nolock()) ffff9f33012b4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789123014.546969:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876031381184512:12345-0@lo:38: Request processed in 124us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123014.546976:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789123014.547008:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f3409d49e00 x1876031381184512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789123024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123014.547018:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789123014.547024:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789123014.547029:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789123014.547039:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789123014.547042:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9f3301317800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789123014.547047:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1876031381184512:0@lo:38: 00000100:00100000:1.0:1789123014.547171:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876031381184640:0@lo:400: 00000100:00100000:1.0:1789123014.547198:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123014.548431:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381184640 00000100:00100000:3.0:1789123014.548438:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381184640 00000100:00100000:3.0:1789123014.549735:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789123014.549750:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876031381184640:12345-0@lo:400: 00000100:00100000:3.0:1789123014.549837:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876031381184640:12345-0@lo:400: Request processed in 91us (2638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123014.549845:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789123014.549910:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f3409cb5a40 x1876031381184640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123014.549925:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876031381184640:0@lo:400: 00000040:00080000:1.0:1789123014.552891:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1789123014.552993:0:6682:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1789123014.553017:0:6682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789123014.553034:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401514e00/0x7e1648d68fc9193d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91944 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123014.553045:0:6682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f3401514e00/0x7e1648d68fc9193d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91944 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789123014.553106:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789123014.553108:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789123014.553109:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789123014.553111:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789123014.553112:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789123014.553113:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789123014.553114:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789123014.553116:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789123014.553118:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789123014.553119:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789123014.553120:0:6682:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789123014.553124:0:6682:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1789123014.553127:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789123014.553128:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789123014.553129:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789123014.553130:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789123014.553131:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789123014.553133:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789123014.553134:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789123014.553141:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789123014.553142:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789123014.553143:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789123014.553143:0:6682:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789123014.553167:0:6682:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789123014.553183:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d49680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381184768:0@lo:253: 00000100:00100000:1.0:1789123014.555451:0:6682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123014.557601:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408def000 going to sleep for 11 seconds 00000100:00100000:3.0:1789123014.557705:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381184768 00000100:00100000:3.0:1789123014.557714:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381184768 00000100:00100000:3.0:1789123014.557770:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789123014.557780:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:6682:x1876031381184768:12345-0@lo:253: 20000000:01000000:3.0:1789123014.557814:0:5834:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789123014.557827:0:5834:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789123014.596247:0:5834:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789123014.596267:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1789123014.596477:0:5856:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789123014.596482:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789123014.596501:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f34421d8c00/0x7e1648d68fc91960 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123014.596519:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f3400030c00/0x7e1648d68fc918bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc918b8 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123014.596528:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f34421d8c00/0x7e1648d68fc91960 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123014.596565:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f3400030c00/0x7e1648d68fc918bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc918b8 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123014.596580:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f3400030c00/0x7e1648d68fc918bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc918b8 expref: 13 pid: 5833 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123014.596594:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d48000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1876031381184896:0@lo:104: 00000100:00100000:1.0:1789123014.596697:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123014.596745:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f33012449c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789123014.598598:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381184896 00000100:00100000:2.0:1789123014.598610:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381184896 00000100:00100000:2.0:1789123014.598754:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789123014.598763:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:5856:x1876031381184896:12345-0@lo:104: 00010000:00010000:2.0:1789123014.598781:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f34421d8000/0x7e1648d68fc918b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc918bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123014.598981:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789123014.598987:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:5856:x1876031381184896:12345-0@lo:104: Request processed in 226us (2291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123014.598995:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789123014.599081:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d48000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1876031381184896:0@lo:104: 00010000:00010000:1.0:1789123014.599101:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f34421d8c00/0x7e1648d68fc91960 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.599245:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789123014.599253:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f34421d8000/0x7e1648d68fc918b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc918bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.599267:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34421d8000 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:3.0:1789123014.599272:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f34421d8000/0x7e1648d68fc918b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc918bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.599280:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f34421d8000/0x7e1648d68fc918b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc918bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789123014.599286:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f34421d8000/0x7e1648d68fc918b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc918bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789123014.599292:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789123014.599351:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f34421d8000/0x7e1648d68fc918b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc918bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.599357:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789123014.599617:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f34421d8000/0x7e1648d68fc918b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc918bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.599706:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f34421d8000/0x7e1648d68fc918b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc918bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.599726:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123014.599728:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123014.599730:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123014.599770:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789123014.599784:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381185024:0@lo:103: 00000100:00100000:1.0:1789123014.599888:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123014.600446:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381185024 00000100:00100000:3.0:1789123014.600452:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381185024 00010000:00010000:3.0:1789123014.600475:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f3400030c00/0x7e1648d68fc918bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc918b8 expref: 14 pid: 5833 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123014.600507:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789123014.600523:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3406287450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:3304:x1876031381185024:12345-0@lo:103: 00010000:00010000:3.0:1789123014.600535:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123014.600540:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f3400030c00/0x7e1648d68fc918bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc918b8 expref: 14 pid: 5833 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.600551:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f3400030c00/0x7e1648d68fc918bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc918b8 expref: 14 pid: 5833 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.600566:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3400030c00/0x7e1648d68fc918bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc918b8 expref: 14 pid: 5833 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.600580:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f34421d8c00/0x7e1648d68fc91960 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.600588:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f34421d8c00/0x7e1648d68fc91960 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789123014.600602:0:5824:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012851513s 00010000:00010000:3.0:1789123014.600606:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f34421d8c00/0x7e1648d68fc91960 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.600614:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f34421d8c00/0x7e1648d68fc91960 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.600620:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f34421d8c00/0x7e1648d68fc91960 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.600901:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f34421d8c00/0x7e1648d68fc91960 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.600908:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34421d8c00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:3.0:1789123014.600917:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f34421d8c00/0x7e1648d68fc91960 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.600926:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f34421d8c00/0x7e1648d68fc91960 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.600939:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f34421d8c00/0x7e1648d68fc91960 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.600950:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789123014.600994:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3406287450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:3304:x1876031381185024:12345-0@lo:103: Request processed in 471us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123014.601001:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789123014.601058:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381185024:0@lo:103: 00010000:00010000:3.0:1789123014.601077:0:5856:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f34421d8c00/0x7e1648d68fc91960 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.601085:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f34421d8c00/0x7e1648d68fc91960 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123014.601091:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f34421d8c00/0x7e1648d68fc91960 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123014.607288:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:6682:x1876031381184768:12345-0@lo:253: Request processed in 49501us (51832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123014.607302:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789123014.607419:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d49680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:6682:1876031381184768:0@lo:253: 10000000:01000000:1.0:1789123014.607433:0:6682:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789123014.607437:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789123014.607438:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789123014.607440:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789123014.607441:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789123014.607442:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789123014.607443:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789123014.607445:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789123014.607446:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789123014.607448:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789123014.607449:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789123014.607451:0:6682:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789123014.607465:0:6682:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789123014.613100:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789123014.613358:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789123014.613566:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789123014.613995:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789123014.614379:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:2.0:1789123014.614581:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789123014.617033:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789123014.870235:0:6682:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789123014.870242:0:6682:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789123014.870277:0:6682:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789123014.870349:0:6682:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.130@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789123014.870366:0:6682:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789123014.870390:0:6682:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1789123015.173372:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123016.197732:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123017.224683:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123018.244783:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123019.276427:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123019.782419:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381185152:0@lo:400: 00000100:00100000:2.0:1789123019.782419:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d56d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876031381185280:0@lo:400: 00000100:00100000:2.0:1789123019.782616:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123019.783325:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123019.783328:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381185280 00000100:00100000:2.0:1789123019.783337:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381185280 00000100:00100000:3.0:1789123019.783376:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381185408:0@lo:400: 00000100:00100000:2.0:1789123019.783386:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789123019.783395:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409c9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876031381185280:12345-0@lo:400: 00000100:00100000:3.0:1789123019.783411:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123019.783453:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381185152 00000100:00100000:3.0:1789123019.783458:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381185152 00000100:00100000:3.0:1789123019.783495:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789123019.783502:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:3302:x1876031381185152:12345-0@lo:400: 00000100:00100000:2.0:1789123019.783811:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409c9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876031381185280:12345-0@lo:400: Request processed in 415us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123019.783819:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789123019.784256:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381185408 00000100:00100000:2.0:1789123019.784262:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381185408 00000100:00100000:2.0:1789123019.784306:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789123019.784314:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381185408:12345-0@lo:400: 00000100:00080000:1.0:1789123019.784364:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789123019.784568:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381185152:0@lo:400: 00000100:00100000:2.0:1789123019.791159:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381185408:12345-0@lo:400: Request processed in 6838us (7740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123019.791172:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789123019.791244:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f3409d56d00 x1876031381185280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123019.791258:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d56d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876031381185280:0@lo:400: 00000100:00100000:3.0:1789123019.791268:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:3302:x1876031381185152:12345-0@lo:400: Request processed in 7762us (7941us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123019.791279:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1789123019.791363:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f3409d56940 x1876031381185408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123019.791374:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381185408:0@lo:400: 00010000:00010000:0.0:1789123020.292746:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789123020.616496:0:7050:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789123021.316842:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123022.340720:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789123022.852775:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789123022.852783:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f3408401800 from 21 10000000:01000000:2.0:1789123022.852807:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789123022.852848:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91967 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123022.852860:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91967 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123022.852871:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91967 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123022.852893:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c9a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381185536:0@lo:101: 00000100:00100000:2.0:1789123022.852965:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123022.853073:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f33012ea6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789123022.853609:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381185536 00000100:00100000:0.0:1789123022.853617:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381185536 00000100:00100000:0.0:1789123022.855267:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789123022.855293:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:5838:x1876031381185536:12345-0@lo:101: 00010000:00010000:0.0:1789123022.855310:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123022.855327:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3400031800/0x7e1648d68fc9196e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91967 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123022.855356:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3400031800/0x7e1648d68fc9196e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91967 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123022.855368:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3400031800/0x7e1648d68fc9196e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91967 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123022.855388:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3400031800, rc 0) 00000100:00100000:0.0:1789123022.855463:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:5838:x1876031381185536:12345-0@lo:101: Request processed in 186us (2498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123022.855482:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789123022.855574:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c9a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381185536:0@lo:101: 00010000:00010000:2.0:1789123022.855594:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91967 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc9196e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123022.855605:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91967 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc9196e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123022.855704:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c9a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381185664:0@lo:501: 00000100:00100000:2.0:1789123022.855738:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123022.856126:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f33012ea6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789123022.856214:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381185664 00000100:00100000:3.0:1789123022.856220:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381185664 00000100:00100000:3.0:1789123022.856245:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789123022.856253:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:5838:x1876031381185664:12345-0@lo:501: 00000100:00100000:3.0:1789123022.856696:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:5838:x1876031381185664:12345-0@lo:501: Request processed in 443us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123022.856705:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789123022.856922:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c9a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381185664:0@lo:501: 00000100:00100000:2.0:1789123022.856958:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c9a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381185792:0@lo:503: 00000100:00100000:2.0:1789123022.856998:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123022.857027:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f33012ea6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789123022.858477:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381185792 00000100:00100000:3.0:1789123022.858486:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381185792 00000100:00100000:3.0:1789123022.858539:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789123022.858548:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:5838:x1876031381185792:12345-0@lo:503: 00000100:00100000:3.0:1789123022.865360:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:5838:x1876031381185792:12345-0@lo:503: Request processed in 6803us (8352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123022.865375:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789123022.865551:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c9a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381185792:0@lo:503: 00000100:00100000:2.0:1789123022.870384:0:7154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c9a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:7154:1876031381185920:0@lo:502: 00000100:00100000:2.0:1789123022.870465:0:7154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123022.870524:0:7154:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f33012ea9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789123022.870615:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381185920 00000100:00100000:3.0:1789123022.870621:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381185920 00000100:00100000:3.0:1789123022.870684:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789123022.870693:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:7154:x1876031381185920:12345-0@lo:502: 00000100:00100000:3.0:1789123022.870999:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:7154:x1876031381185920:12345-0@lo:502: Request processed in 306us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123022.871007:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789123022.871148:0:7154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c9a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:7154:1876031381185920:0@lo:502: 00000100:00100000:2.0:1789123022.871203:0:7154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c9a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:7154:1876031381186048:0@lo:502: 00000100:00100000:2.0:1789123022.871237:0:7154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123022.871269:0:7154:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f33012ea9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123022.874783:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381186048 00000100:00100000:1.0:1789123022.874798:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381186048 00000100:00100000:1.0:1789123022.874869:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789123022.874880:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:7154:x1876031381186048:12345-0@lo:502: 00000100:00100000:1.0:1789123022.875151:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:7154:x1876031381186048:12345-0@lo:502: Request processed in 272us (3912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123022.875159:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789123022.875503:0:7154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c9a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:7154:1876031381186048:0@lo:502: 00000040:00080000:2.0:1789123022.875545:0:7154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789123022.875743:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789123022.875761:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789123022.875771:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91967 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc9196e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123022.875782:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91967 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc9196e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789123022.875791:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789123022.875794:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f3408401800 from 4 10000000:01000000:0.0:1789123022.875797:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789123022.875828:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3400030800/0x7e1648d68fc91975 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123022.875836:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f3400030800/0x7e1648d68fc91975 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123022.875845:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f3400030800/0x7e1648d68fc91975 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123022.875862:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381186176:0@lo:101: 00000100:00100000:0.0:1789123022.875901:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123022.875937:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3404e4fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789123022.876050:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381186176 00000100:00100000:3.0:1789123022.876055:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381186176 00000100:00100000:3.0:1789123022.876092:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789123022.876100:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:5838:x1876031381186176:12345-0@lo:101: 00010000:00010000:3.0:1789123022.876110:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123022.876122:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3401515000/0x7e1648d68fc9197c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91975 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123022.876145:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3401515000/0x7e1648d68fc9197c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91975 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123022.876156:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3401515000/0x7e1648d68fc9197c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91975 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123022.876165:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3401515000, rc 0) 00000100:00100000:3.0:1789123022.876212:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:5838:x1876031381186176:12345-0@lo:101: Request processed in 113us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123022.876219:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789123022.876380:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381186176:0@lo:101: 00010000:00010000:2.0:1789123022.876392:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f3400030800/0x7e1648d68fc91975 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc9197c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123022.876402:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f3400030800/0x7e1648d68fc91975 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc9197c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123022.876448:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c9a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381186304:0@lo:256: 00000100:00100000:2.0:1789123022.876480:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123022.876504:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f33012ea9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789123022.876551:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381186304 00000100:00100000:3.0:1789123022.876555:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381186304 00000100:00100000:3.0:1789123022.876586:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789123022.876592:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:5838:x1876031381186304:12345-0@lo:256: 20000000:01000000:3.0:1789123022.876605:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789123022.876622:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789123022.876669:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789123022.876758:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:5838:x1876031381186304:12345-0@lo:256: Request processed in 166us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123022.876766:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789123022.877037:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c9a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381186304:0@lo:256: 10000000:01000000:2.0:1789123022.877077:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789123022.877084:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3400030800/0x7e1648d68fc91975 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc9197c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123022.877093:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f3400030800/0x7e1648d68fc91975 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc9197c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123022.877105:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789123022.877107:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1789123022.877110:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789123022.877127:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91983 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123022.877135:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91983 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123022.877143:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91983 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123022.877155:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c9a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381186432:0@lo:101: 00000100:00100000:2.0:1789123022.877181:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123022.877211:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f33012ea9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123022.877261:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381186432 00000100:00100000:1.0:1789123022.877272:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381186432 00000100:00100000:1.0:1789123022.877327:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789123022.877334:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:5838:x1876031381186432:12345-0@lo:101: 00010000:00010000:1.0:1789123022.877342:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123022.877352:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f34421d8c00/0x7e1648d68fc9198a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91983 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123022.877369:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f34421d8c00/0x7e1648d68fc9198a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91983 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123022.877377:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f34421d8c00/0x7e1648d68fc9198a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91983 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123022.877384:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f34421d8c00, rc 0) 00000100:00100000:1.0:1789123022.877421:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:5838:x1876031381186432:12345-0@lo:101: Request processed in 88us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123022.877427:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789123022.877533:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c9a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381186432:0@lo:101: 00010000:00010000:2.0:1789123022.877546:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91983 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc9198a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123022.877554:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91983 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc9198a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123022.877596:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c9a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381186560:0@lo:501: 00000100:00100000:2.0:1789123022.877621:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123022.877679:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f33012ea9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789123022.877800:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381186560 00000100:00100000:0.0:1789123022.877804:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381186560 00000100:00100000:0.0:1789123022.877836:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789123022.877844:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:5838:x1876031381186560:12345-0@lo:501: 00000100:00100000:0.0:1789123022.878088:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:5838:x1876031381186560:12345-0@lo:501: Request processed in 244us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123022.878101:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789123022.879926:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c9a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381186560:0@lo:501: 00000100:00100000:2.0:1789123022.879982:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c9a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381186688:0@lo:503: 00000100:00100000:2.0:1789123022.880053:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123022.880096:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f33012ea9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789123022.880156:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381186688 00000100:00100000:0.0:1789123022.880162:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381186688 00000100:00100000:0.0:1789123022.880209:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789123022.880218:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:5838:x1876031381186688:12345-0@lo:503: 00000100:00100000:0.0:1789123022.880862:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:5838:x1876031381186688:12345-0@lo:503: Request processed in 642us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123022.880871:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789123022.882359:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c9a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381186688:0@lo:503: 00000100:00100000:0.0:1789123022.886092:0:7155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:7155:1876031381186816:0@lo:502: 00000100:00100000:0.0:1789123022.886174:0:7155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123022.886221:0:7155:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3418366300 going to sleep for 11 seconds 00000100:00100000:3.0:1789123022.886295:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381186816 00000100:00100000:3.0:1789123022.886302:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381186816 00000100:00100000:3.0:1789123022.886352:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789123022.886361:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:7155:x1876031381186816:12345-0@lo:502: 00000100:00100000:2.0:1789123022.886941:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:7155:x1876031381186816:12345-0@lo:502: Request processed in 579us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123022.886950:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789123022.887045:0:7155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:7155:1876031381186816:0@lo:502: 00000020:01000000:0.0:1789123022.887082:0:7155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789123022.887089:0:7155:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789123022.887095:0:7155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789123022.887097:0:7155:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789123022.887103:0:7155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789123022.887107:0:7155:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.130@tcp to nid 0x20000c0a8ce82 (192.168.206.130@tcp) 00000020:01000000:0.0:1789123022.887130:0:7155:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789123022.887133:0:7155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789123022.887147:0:7155:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9f342d8a8000) 00000020:00000080:0.0:1789123022.887167:0:7155:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1789123022.887173:0:7155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789123022.887245:0:7155:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789123022.887251:0:7155:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789123022.887257:0:7155:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7e1648d68fc91998 00010000:00080000:0.0:1789123022.887314:0:7155:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f34067c2800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.130@tcp at head 00010000:00010000:0.0:1789123022.887534:0:7155:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1789123022.942364:0:7155:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789123022.942470:0:7155:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789123022.943118:0:7155:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789123022.944572:0:7155:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789123022.944650:0:7155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1789123022.944716:0:7155:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1789123022.946109:0:7157:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789123022.946115:0:7157:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789123022.947913:0:7155:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789123022.947926:0:7155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789123022.947961:0:7155:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789123022.947981:0:7155:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7e1648d68fc9199f 00000100:00080000:2.0:1789123022.947991:0:7155:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789123022.947997:0:7155:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f34067c2800 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:2.0:1789123022.948029:0:7155:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f3409c9a1c0 x1876031381186944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789123022.948060:0:7155:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789123022.948121:0:7155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789123022.948125:0:7155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789123022.948127:0:7155:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789123022.948130:0:7155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789123022.948134:0:7155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789123022.948136:0:7155:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789123022.948146:0:7155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789123022.948148:0:7155:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789123022.948246:0:7155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c99680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:7155:1876031381187072:0@lo:502: 00000100:00100000:2.0:1789123022.948332:0:7155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123022.948383:0:7155:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f33012ea240 going to sleep for 11 seconds 00000100:00100000:0.0:1789123022.948503:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381187072 00000100:00100000:0.0:1789123022.948510:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381187072 00000100:00100000:0.0:1789123022.948546:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789123022.948555:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:7155:x1876031381187072:12345-0@lo:502: 00000100:00100000:0.0:1789123022.948795:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:7155:x1876031381187072:12345-0@lo:502: Request processed in 240us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123022.948802:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789123022.948843:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381187328:0@lo:400: 00000100:00100000:0.0:1789123022.948871:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123022.948915:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381187328 00000100:00100000:0.0:1789123022.948919:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381187328 00000100:00100000:0.0:1789123022.948955:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789123022.948961:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381187328:12345-0@lo:400: 00000100:00100000:0.0:1789123022.948996:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381187328:12345-0@lo:400: Request processed in 36us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123022.949002:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789123022.949018:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789123022.949045:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f3409cb6580 x1876031381187328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123022.949057:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381187328:0@lo:400: 00000100:00100000:0.0:1789123022.949083:0:7155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c99680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:7155:1876031381187072:0@lo:502: 00000020:01000000:0.0:1789123022.949110:0:7155:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789123022.949115:0:7155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789123022.949117:0:7155:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789123022.949121:0:7155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1789123022.949164:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1789123022.949253:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789123022.949268:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91983 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc9198a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123022.949287:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91983 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc9198a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789123022.949298:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789123022.949301:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f3407c54ed8 from 1 10000000:01000000:0.0:1789123022.949304:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789123022.949327:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3400030400/0x7e1648d68fc919a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123022.949335:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f3400030400/0x7e1648d68fc919a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123022.949344:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f3400030400/0x7e1648d68fc919a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123022.949356:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381187456:0@lo:101: 00000100:00100000:0.0:1789123022.949382:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123022.949399:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3418366f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789123022.949413:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381187456 00000100:00100000:0.0:1789123022.949416:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381187456 00000100:00100000:0.0:1789123022.949437:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789123022.949443:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:5838:x1876031381187456:12345-0@lo:101: 00010000:00010000:0.0:1789123022.949451:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123022.949462:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3400031000/0x7e1648d68fc919ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc919a6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123022.949481:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3400031000/0x7e1648d68fc919ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc919a6 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123022.949498:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3400031000/0x7e1648d68fc919ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc919a6 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123022.949507:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3400031000, rc 0) 00000100:00100000:0.0:1789123022.949535:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:5838:x1876031381187456:12345-0@lo:101: Request processed in 92us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123022.949541:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789123022.949584:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381187456:0@lo:101: 00010000:00010000:0.0:1789123022.949596:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f3400030400/0x7e1648d68fc919a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc919ad expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123022.949604:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f3400030400/0x7e1648d68fc919a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc919ad expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123022.949660:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381187584:0@lo:501: 00000100:00100000:0.0:1789123022.949686:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123022.949698:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3418366f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789123022.949711:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381187584 00000100:00100000:0.0:1789123022.949715:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381187584 00000100:00100000:0.0:1789123022.949735:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789123022.949741:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:5838:x1876031381187584:12345-0@lo:501: 00000100:00100000:0.0:1789123022.949920:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:5838:x1876031381187584:12345-0@lo:501: Request processed in 178us (232us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789123022.949926:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789123022.949955:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381187584:0@lo:501: 10000000:01000000:0.0:1789123022.949973:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789123022.949984:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3400030400/0x7e1648d68fc919a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc919ad expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123022.949990:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f3400030400/0x7e1648d68fc919a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc919ad expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123022.950126:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c9a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876031381186944:0@lo:8: 00000100:00100000:3.0:1789123022.950164:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123022.950221:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789123022.950230:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876031381187200:0@lo:400: 00000100:00100000:3.0:1789123022.950257:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123022.950293:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381187200 00000100:00100000:3.0:1789123022.950297:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381187200 00000100:00100000:3.0:1789123022.950323:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789123022.950330:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876031381187200:12345-0@lo:400: 00000100:00100000:3.0:1789123022.950367:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876031381187200:12345-0@lo:400: Request processed in 37us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123022.950373:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789123022.950402:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f3409cb70c0 x1876031381187200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123022.950411:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876031381187200:0@lo:400: 00000100:00100000:0.0:1789123022.950576:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381186944 00000100:00100000:0.0:1789123022.950581:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381186944 00000100:00100000:0.0:1789123022.950666:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789123022.950672:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1876031381186944:12345-0@lo:8: 00010000:00080000:0.0:1789123022.950692:0:6686:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 137 last 0 00000020:00000080:0.0:1789123022.950716:0:6686:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7e1648d68fc919b4 00002000:00100000:0.0:1789123022.950750:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9f34067c2000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398a ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789123022.950755:0:6686:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1789123022.950758:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1789123022.950857:0:6686:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789123022.951003:0:6686:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789123022.951025:0:6686:0:(import.c:65:import_set_state_nolock()) ffff9f34067c6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789123022.951064:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1876031381186944:12345-0@lo:8: Request processed in 391us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123022.951071:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789123022.951135:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f3409c9a1c0 x1876031381186944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789123032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123022.951144:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789123022.951150:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789123022.951165:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789123022.951169:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789123022.951183:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9f34067c2800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789123022.951198:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789123022.951203:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c9a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876031381186944:0@lo:8: 00000004:00080000:3.0:1789123022.951224:0:7157:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789123022.951331:0:7157:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 137281702837ns, next at 0ns, rc = 0 00000004:00080000:1.0:1789123022.971496:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1789123022.994011:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381187712:0@lo:13: 00000100:00100000:0.0:1789123022.994084:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789123022.994203:0:7158:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789123022.994227:0:7158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d56d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7158:1876031381187840:0@lo:7: 00000100:00100000:3.0:1789123022.994256:0:7158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123022.994322:0:7158:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f343c34fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123022.994513:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381187712 00000100:00100000:1.0:1789123022.994520:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381187712 00000100:00100000:1.0:1789123022.994619:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789123022.994652:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1876031381187712:12345-0@lo:13: 00002000:00000024:1.0:1789123022.994684:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1789123022.994741:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1876031381187712:12345-0@lo:13: Request processed in 113us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123022.994748:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789123022.994774:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381187840 00000100:00100000:1.0:1789123022.994778:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381187840 00000100:00100000:1.0:1789123022.994800:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789123022.994821:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7158:x1876031381187840:12345-0@lo:7: 00010000:00080000:2.0:1789123022.995226:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f3409d56940 x1876031381187712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123038 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123022.995246:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381187712:0@lo:13: 00000100:00080000:0.0:1789123022.996258:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1789123023.000989:0:6688:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1789123023.000997:0:6688:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789123023.001303:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7158:x1876031381187840:12345-0@lo:7: Request processed in 6479us (7042us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123023.001313:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789123023.001412:0:7158:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f3409d56d00 x1876031381187840/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789123038 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123023.001427:0:7158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d56d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7158:1876031381187840:0@lo:7: 00000004:00080000:3.0:1789123023.001440:0:7158:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789123023.001477:0:7158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d56d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7158:1876031381187968:0@lo:5: 00000100:00100000:3.0:1789123023.001510:0:7158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123023.001606:0:7158:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f343c34fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789123023.001777:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381187968 00000100:00100000:0.0:1789123023.001785:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381187968 00000100:00100000:2.0:1789123023.001960:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789123023.001970:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d55e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7158:x1876031381187968:12345-0@lo:5: 00002000:00080000:2.0:1789123023.001995:0:6686:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789123023.001999:0:6686:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789123023.002453:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d55e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7158:x1876031381187968:12345-0@lo:5: Request processed in 484us (941us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789123023.002461:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789123023.002528:0:7158:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f3409d56d00 x1876031381187968/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789123039 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123023.002542:0:7158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d56d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7158:1876031381187968:0@lo:5: 00000004:00080000:3.0:1789123023.002552:0:7158:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789123023.002579:0:7158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7158:1876031381188096:0@lo:700: 00000100:00100000:3.0:1789123023.002606:0:7158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123023.002664:0:7158:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f343c34fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123023.002724:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381188096 00000100:00100000:1.0:1789123023.002730:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381188096 00000100:00100000:1.0:1789123023.002766:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789123023.002774:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d57840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7158:x1876031381188096:12345-0@lo:700: 00000100:00100000:1.0:1789123023.002805:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d4a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6694:1876031381188224:0@lo:700: 00000100:00100000:1.0:1789123023.002836:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123023.002862:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34184e6300 going to sleep for 11 seconds 00000100:00100000:0.0:1789123023.003068:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381188224 00000100:00100000:0.0:1789123023.003073:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381188224 00000100:00100000:0.0:1789123023.003266:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789123023.003274:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6694:x1876031381188224:12345-0@lo:700: 40000000:02000000:2.0:1789123023.027515:0:5847:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1789123023.032805:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6694:x1876031381188224:12345-0@lo:700: Request processed in 29524us (29959us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123023.032823:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789123023.032893:0:6694:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f3409d4a1c0 x1876031381188224/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789123039 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123023.032907:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d4a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6694:1876031381188224:0@lo:700: 40000000:02000000:1.0:1789123023.032920:0:6694:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:0.0:1789123023.091087:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d57840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7158:x1876031381188096:12345-0@lo:700: Request processed in 88307us (88472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123023.091106:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789123023.091294:0:7158:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f3409d55680 x1876031381188096/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789123039 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123023.091311:0:7158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7158:1876031381188096:0@lo:700: 00000001:00100000:2.0:1789123023.092037:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1789123023.092059:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000004:02000040:3.0:1789123023.110014:0:7158:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1789123023.113100:0:7158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7158:1876031381188352:0@lo:5: 00000100:00100000:3.0:1789123023.113163:0:7158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123023.113329:0:7158:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f343c34fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789123023.113423:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381188352 00000100:00100000:1.0:1789123023.113429:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381188352 00000100:00100000:1.0:1789123023.113506:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789123023.113515:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d57c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7158:x1876031381188352:12345-0@lo:5: 00002000:00080000:3.0:1789123023.121675:0:6688:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789123023.121696:0:6688:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1789123023.124232:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d57c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7158:x1876031381188352:12345-0@lo:5: Request processed in 10712us (11062us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789123023.124249:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789123023.124451:0:7158:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f3409d55680 x1876031381188352/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789123039 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123023.124464:0:7158:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789123023.124485:0:7158:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9f3409d55680 x1876031381188352/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789123039 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123023.124510:0:7158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7158:1876031381188352:0@lo:5: 00000004:00080000:1.0:1789123023.124524:0:7158:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1789123023.365130:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123024.388751:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789123025.178311:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1789123025.412789:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123026.436954:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123027.467896:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123027.974502:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d56d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876031381188608:0@lo:400: 00000100:00100000:3.0:1789123027.974622:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123027.974701:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789123027.974708:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381188480:0@lo:400: 00000100:00100000:3.0:1789123027.974739:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123027.974905:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381188736:0@lo:400: 00000100:00100000:3.0:1789123027.974933:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123027.974998:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789123027.975004:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3405de0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381188864:0@lo:400: 00000100:00100000:3.0:1789123027.975029:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123027.976577:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381188608 00000100:00100000:2.0:1789123027.976588:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381188608 00000100:00100000:2.0:1789123027.976690:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381188736 00000100:00100000:2.0:1789123027.976694:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381188736 00000100:00100000:2.0:1789123027.976822:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789123027.976842:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876031381188608:12345-0@lo:400: 00000100:00100000:2.0:1789123027.976921:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876031381188608:12345-0@lo:400: Request processed in 82us (2298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123027.976929:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789123027.976945:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789123027.976952:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381188736:12345-0@lo:400: 00000100:00100000:2.0:1789123027.976985:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381188736:12345-0@lo:400: Request processed in 34us (2051us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123027.976991:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789123027.977281:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381188480 00000100:00100000:3.0:1789123027.977287:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381188480 00000100:00100000:3.0:1789123027.977318:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789123027.977325:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:3305:x1876031381188480:12345-0@lo:400: 00000100:00100000:3.0:1789123027.977371:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:3305:x1876031381188480:12345-0@lo:400: Request processed in 47us (2631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123027.977378:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789123027.977408:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381188864 00000100:00100000:3.0:1789123027.977412:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381188864 00000100:00100000:3.0:1789123027.977438:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789123027.977444:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381188864:12345-0@lo:400: 00000100:00100000:3.0:1789123027.977470:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381188864:12345-0@lo:400: Request processed in 27us (2441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123027.977476:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789123027.977513:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f3405de0000 x1876031381188864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123027.977524:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789123027.977540:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3405de0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381188864:0@lo:400: 00010000:00080000:3.0:1789123027.977550:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f3409d56940 x1876031381188736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123027.977558:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381188736:0@lo:400: 00000100:00100000:3.0:1789123027.977584:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381188480:0@lo:400: 00010000:00080000:3.0:1789123027.977593:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f3409d56d00 x1876031381188608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123027.977601:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d56d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876031381188608:0@lo:400: 00000100:00080000:1.0:1789123027.977713:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789123027.977718:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789123028.486067:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381188992:0@lo:13: 00000100:00100000:3.0:1789123028.486122:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123028.486193:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381188992 00000100:00100000:3.0:1789123028.486204:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381188992 00000100:00100000:3.0:1789123028.486237:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789123028.486245:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381188992:12345-0@lo:13: 00002000:00000024:3.0:1789123028.486299:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00010000:1.0:1789123028.486299:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123028.486355:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381188992:12345-0@lo:13: Request processed in 110us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123028.486364:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789123028.486381:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f3409d48b40 x1876031381188992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123028.486398:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381188992:0@lo:13: 00010000:00010000:1.0:1789123029.509497:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123030.535787:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789123030.627710:0:7626:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789123030.627714:0:7626:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789123030.627818:0:7626:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f3406274800 00000020:01000004:3.0:1789123030.627835:0:7626:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789123030.627847:0:7626:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789123030.627859:0:7626:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9f343bd04ed8) 00000020:00000080:3.0:1789123030.627876:0:7626:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789123030.645858:0:7626:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1789123030.646272:0:7626:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1789123030.669827:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1789123030.695117:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789123030.695148:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1789123030.695294:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789123030.695318:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1789123030.695715:0:7626:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789123030.695728:0:7626:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789123030.695738:0:7626:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7e1648d68fc919c2 00000020:01000004:0.0:1789123030.695745:0:7626:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1789123030.695764:0:7626:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.130@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789123030.695768:0:7626:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789123030.695773:0:7626:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789123030.695794:0:7626:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1789123030.695797:0:7626:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.130@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789123030.724947:0:7626:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.130@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789123030.724988:0:7626:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.130@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1789123030.724992:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789123030.724994:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789123030.724995:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789123030.724997:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789123030.724998:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789123030.724999:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789123030.725001:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789123030.725002:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789123030.725004:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789123030.725006:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789123030.725007:0:7626:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789123030.725011:0:7626:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1789123030.725013:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789123030.725014:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789123030.725015:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789123030.725016:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789123030.725018:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789123030.725019:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789123030.725020:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789123030.725026:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789123030.725027:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789123030.725028:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789123030.725029:0:7626:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789123030.725061:0:7626:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789123030.725078:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3405de3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381189120:0@lo:253: 00000100:00100000:3.0:1789123030.725141:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123030.725203:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3407903600 going to sleep for 11 seconds 00000100:00100000:0.0:1789123030.725226:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381189120 00000100:00100000:0.0:1789123030.725246:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381189120 00000100:00100000:3.0:1789123030.725346:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789123030.725354:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:7626:x1876031381189120:12345-0@lo:253: 20000000:01000000:3.0:1789123030.725380:0:5833:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789123030.725384:0:5833:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1789123030.725388:0:5833:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1789123030.725392:0:5833:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1789123030.726772:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789123030.726970:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1789123030.726983:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1789123030.727024:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1789123030.727034:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1789123030.727065:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1789123030.727120:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1789123030.727961:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1789123030.727980:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.130@tcp 20000000:01000000:2.0:1789123030.727982:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.130@tcp (null) (null) (null) 00000040:00080000:2.0:1789123030.728015:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1789123030.728023:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789123030.728065:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1789123030.728072:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.130@tcp (null) (null) 00000040:00080000:2.0:1789123030.728296:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1789123030.728311:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789123030.728353:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1789123030.728408:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1789123030.729507:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1789123030.729527:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.130@tcp 20000000:01000000:2.0:1789123030.729536:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.130@tcp (null) (null) (null) 00000040:00080000:2.0:1789123030.729719:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1789123030.729729:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789123030.729762:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1789123030.729769:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.130@tcp (null) (null) 00000040:00080000:2.0:1789123030.729800:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1789123030.729808:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789123030.729857:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1789123030.729892:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1789123030.729906:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1789123030.729909:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1789123030.729914:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789123030.729916:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789123030.729918:0:5833:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789123030.729928:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789123030.729930:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789123030.729960:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789123030.729963:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789123030.737446:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1789123030.737544:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1789123030.737619:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1789123030.738169:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1789123030.738229:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1789123030.738473:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1789123030.738487:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789123030.738489:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789123030.745754:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1789123030.745839:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1789123030.745907:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1789123030.746290:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1789123030.746340:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1789123030.746377:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1789123030.746390:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789123030.746392:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789123030.746951:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1789123030.747144:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1789123030.747199:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1789123030.747817:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1789123030.747835:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789123030.747838:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789123030.749294:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1789123030.749381:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1789123030.749414:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1789123030.749741:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1789123030.750335:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1789123030.750406:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:2.0:1789123030.750436:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789123030.750458:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f34029f2000/0x7e1648d68fc919c9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123030.750474:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f3400031c00/0x7e1648d68fc9191a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91913 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123030.750482:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f34029f3600/0x7e1648d68fc91944 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc9193d expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123030.750489:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f3400031800/0x7e1648d68fc9196e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91967 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123030.750495:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f34421d8c00/0x7e1648d68fc9198a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91983 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123030.750502:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f3400031000/0x7e1648d68fc919ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc919a6 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123030.750509:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f34029f2000/0x7e1648d68fc919c9 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123030.750544:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f3400031000/0x7e1648d68fc919ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc919a6 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123030.750559:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f3400031000/0x7e1648d68fc919ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc919a6 expref: 16 pid: 5833 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123030.750572:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c9a1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1876031381189248:0@lo:104: 00000100:00100000:2.0:1789123030.750657:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789123030.750716:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f34421d8c00/0x7e1648d68fc9198a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc91983 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123030.750730:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1789123030.750734:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f34421d8c00/0x7e1648d68fc9198a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc91983 expref: 16 pid: 5835 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123030.750746:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381189248 00000100:00100000:2.0:1789123030.750746:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c99680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1876031381189376:0@lo:104: 00000100:00100000:3.0:1789123030.750755:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381189248 00000100:00100000:2.0:1789123030.750777:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789123030.750868:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f3400031800/0x7e1648d68fc9196e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc91967 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123030.750877:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f3400031800/0x7e1648d68fc9196e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc91967 expref: 16 pid: 5834 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123030.750887:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435670000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1876031381189504:0@lo:104: 00000100:00100000:2.0:1789123030.750911:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789123030.755189:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f34029f3600/0x7e1648d68fc91944 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc9193d expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123030.755352:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f34029f3600/0x7e1648d68fc91944 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc9193d expref: 16 pid: 5834 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123030.755367:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34356730c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1876031381189632:0@lo:104: 00000100:00100000:2.0:1789123030.755419:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123030.758468:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381189376 00000100:00100000:1.0:1789123030.758469:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381189504 00000100:00100000:3.0:1789123030.758482:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381189376 00000100:00100000:1.0:1789123030.758482:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381189504 00000100:00100000:1.0:1789123030.758542:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789123030.758551:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3406795050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+5:5833:x1876031381189248:12345-0@lo:104: 00010000:00010000:1.0:1789123030.758567:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f3400030400/0x7e1648d68fc919a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc919ad expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123030.758706:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789123030.758712:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3406795050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+5:5833:x1876031381189248:12345-0@lo:104: Request processed in 163us (8057us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123030.758732:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789123030.758778:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789123030.758785:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409c983c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+4:5833:x1876031381189376:12345-0@lo:104: 00010000:00010000:1.0:1789123030.758793:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91983 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc9198a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123030.758841:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789123030.758846:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409c983c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+4:5833:x1876031381189376:12345-0@lo:104: Request processed in 63us (8069us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123030.758853:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1789123030.758868:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789123030.759033:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f3400030400/0x7e1648d68fc919a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc919ad expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123030.759041:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3400030400 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:1.0:1789123030.759045:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f3400030400/0x7e1648d68fc919a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc919ad expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123030.759054:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f3400030400/0x7e1648d68fc919a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc919ad expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789123030.759061:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f3400030400/0x7e1648d68fc919a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc919ad expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789123030.759067:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789123030.759097:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f3400030400/0x7e1648d68fc919a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc919ad expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123030.759102:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789123030.759127:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f3400030400/0x7e1648d68fc919a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc919ad expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123030.759134:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f3400030400/0x7e1648d68fc919a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc919ad expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123030.759147:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789123030.759150:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91983 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc9198a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123030.759156:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34029f2a00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:1.0:1789123030.759158:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91983 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc9198a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123030.759164:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc9198a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789123030.759170:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc9198a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789123030.759176:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789123030.759189:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91983 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc9198a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123030.759194:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789123030.759207:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91983 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc9198a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123030.759214:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91983 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc9198a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123030.759224:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123030.759231:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123030.759232:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123030.759251:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789123030.759265:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d4b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381189760:0@lo:103: 00000100:00100000:1.0:1789123030.759301:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789123030.759375:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123030.760411:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789123030.760428:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435672940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:5833:x1876031381189504:12345-0@lo:104: 00010000:00010000:3.0:1789123030.760443:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91967 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc9196e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123030.760503:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789123030.760508:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435672940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:5833:x1876031381189504:12345-0@lo:104: Request processed in 88us (9597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123030.760516:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789123030.760581:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789123030.760588:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91967 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc9196e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.760597:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34029f2600 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:0.0:1789123030.760600:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91967 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc9196e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.760608:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc9196e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789123030.760615:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc9196e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789123030.760620:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789123030.760671:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91967 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc9196e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.760678:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789123030.760686:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91967 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc9196e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.760692:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91967 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc9196e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.760703:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123030.760714:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123030.760716:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123030.767573:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381189760 00000100:00100000:2.0:1789123030.767586:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381189760 00010000:00010000:2.0:1789123030.767664:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f3400031000/0x7e1648d68fc919ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc919a6 expref: 17 pid: 5833 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123030.767703:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789123030.767712:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:3304:x1876031381189760:12345-0@lo:103: 00010000:00010000:2.0:1789123030.767734:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123030.767739:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f3400031000/0x7e1648d68fc919ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc919a6 expref: 17 pid: 5833 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123030.767751:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f3400031000/0x7e1648d68fc919ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc919a6 expref: 17 pid: 5833 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123030.767770:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123030.767826:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:3304:x1876031381189760:12345-0@lo:103: Request processed in 115us (8524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123030.767832:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789123030.767885:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d4b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381189760:0@lo:103: 00010000:00010000:2.0:1789123030.767939:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f3400031c00/0x7e1648d68fc9191a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc91913 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123030.767952:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f3400031c00/0x7e1648d68fc9191a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc91913 expref: 16 pid: 5833 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123030.767981:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34356712c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1876031381190144:0@lo:104: 00000100:00100000:2.0:1789123030.768015:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123030.770139:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381189888:0@lo:103: 00000100:00100000:0.0:1789123030.770207:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123030.770268:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789123030.770285:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381190016:0@lo:103: 00000100:00100000:3.0:1789123030.770303:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381189632 00000100:00100000:0.0:1789123030.770310:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123030.770312:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381189632 00000100:00100000:0.0:1789123030.770352:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381189888 00000100:00100000:0.0:1789123030.770357:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381189888 00010000:00010000:0.0:1789123030.770380:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f34421d8c00/0x7e1648d68fc9198a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91983 expref: 17 pid: 5835 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123030.770403:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381190016 00000100:00100000:0.0:1789123030.770407:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381190016 00010000:00010000:0.0:1789123030.770419:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f3400031800/0x7e1648d68fc9196e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91967 expref: 18 pid: 5834 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123030.770420:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381190144 00000100:00100000:1.0:1789123030.770428:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381190144 00000100:00100000:0.0:1789123030.770437:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789123030.770447:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:3302:x1876031381189888:12345-0@lo:103: 00010000:00010000:0.0:1789123030.770458:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123030.770463:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f34421d8c00/0x7e1648d68fc9198a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91983 expref: 18 pid: 5835 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.770473:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f34421d8c00/0x7e1648d68fc9198a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc91983 expref: 18 pid: 5835 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.770491:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789123030.770538:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789123030.770545:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435672580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+4:5833:x1876031381189632:12345-0@lo:104: 00010000:00010000:1.0:1789123030.770574:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f3401514e00/0x7e1648d68fc9193d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91944 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123030.770838:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340555a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789123030.770853:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:3302:x1876031381189888:12345-0@lo:103: Request processed in 406us (643us total) trans 0 rc 0/0 00010000:00010000:2.0:1789123030.770864:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3400031000/0x7e1648d68fc919ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc919a6 expref: 18 pid: 5833 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123030.770864:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789123030.770881:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c9a1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1876031381189248:0@lo:104: 00010000:00010000:2.0:1789123030.770896:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f34421d8c00/0x7e1648d68fc9198a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc91983 expref: 16 pid: 5835 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123030.770903:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789123030.770911:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c99680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1876031381189376:0@lo:104: 00000100:00100000:0.0:1789123030.770914:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:3302:x1876031381190016:12345-0@lo:103: 00010000:00010000:0.0:1789123030.770923:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123030.770930:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f3400031800/0x7e1648d68fc9196e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91967 expref: 15 pid: 5834 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123030.770935:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435670000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1876031381189504:0@lo:104: 00010000:00010000:0.0:1789123030.770947:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f3400031800/0x7e1648d68fc9196e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc91967 expref: 15 pid: 5834 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.770959:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3400031800/0x7e1648d68fc9196e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc91967 expref: 15 pid: 5834 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.770970:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789123030.770999:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789123030.771006:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:3302:x1876031381190016:12345-0@lo:103: Request processed in 94us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123030.771008:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435672580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+4:5833:x1876031381189632:12345-0@lo:104: Request processed in 462us (15587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123030.771021:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789123030.771023:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789123030.771045:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789123030.771053:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435673480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:5833:x1876031381190144:12345-0@lo:104: 00000100:00100000:2.0:1789123030.771054:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34356730c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1876031381189632:0@lo:104: 00010000:00010000:0.0:1789123030.771055:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789123030.771064:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f3400030200/0x7e1648d68fc91913 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc9191a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.771065:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f3401514e00/0x7e1648d68fc9193d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91944 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.771074:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401514e00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:0.0:1789123030.771081:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f3401514e00/0x7e1648d68fc9193d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc91944 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.771092:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f3401514e00/0x7e1648d68fc9193d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc91944 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789123030.771100:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f3401514e00/0x7e1648d68fc9193d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc91944 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123030.771114:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381190016:0@lo:103: 10000000:01000000:0.0:1789123030.771118:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789123030.771138:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34356712c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1876031381190144:0@lo:104: 00000100:00100000:3.0:1789123030.771144:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381189888:0@lo:103: 00010000:00010000:2.0:1789123030.771184:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f34029f2000/0x7e1648d68fc919c9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123030.771302:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789123030.771308:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435673480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:5833:x1876031381190144:12345-0@lo:104: Request processed in 257us (3292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123030.771315:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1789123030.772043:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f3401514e00/0x7e1648d68fc9193d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91944 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.772053:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789123030.772082:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f3401514e00/0x7e1648d68fc9193d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91944 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.772088:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f3401514e00/0x7e1648d68fc9193d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91944 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.772102:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789123030.772107:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f3400030200/0x7e1648d68fc91913 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc9191a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.772114:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3400030200 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:0.0:1789123030.772117:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f3400030200/0x7e1648d68fc91913 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc9191a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.772124:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f3400030200/0x7e1648d68fc91913 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc9191a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123030.772129:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 10000000:00010000:0.0:1789123030.772130:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f3400030200/0x7e1648d68fc91913 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc9191a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789123030.772138:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789123030.772145:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381190272:0@lo:103: 00010000:00010000:0.0:1789123030.772152:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f3400030200/0x7e1648d68fc91913 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc9191a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.772158:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789123030.772176:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f3400030200/0x7e1648d68fc91913 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc9191a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.772182:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f3400030200/0x7e1648d68fc91913 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc9191a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.772277:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123030.772301:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123030.772303:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123030.772320:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123030.772351:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123030.772586:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381190400:0@lo:103: 00000100:00100000:3.0:1789123030.772613:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123030.773250:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381190272 00000100:00100000:0.0:1789123030.773259:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381190272 00010000:00010000:0.0:1789123030.773360:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f34029f3600/0x7e1648d68fc91944 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc9193d expref: 14 pid: 5834 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123030.773396:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381190400 00000100:00100000:0.0:1789123030.773400:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381190400 00010000:00010000:0.0:1789123030.773413:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f3400031c00/0x7e1648d68fc9191a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91913 expref: 15 pid: 5833 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123030.773426:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789123030.773434:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:3305:x1876031381190272:12345-0@lo:103: 00010000:00010000:0.0:1789123030.773444:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123030.773449:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f34029f3600/0x7e1648d68fc91944 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc9193d expref: 15 pid: 5834 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.773460:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f34029f3600/0x7e1648d68fc91944 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc9193d expref: 15 pid: 5834 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.773474:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f34029f3600/0x7e1648d68fc91944 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc9193d expref: 15 pid: 5834 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.773498:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123030.773556:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:3305:x1876031381190272:12345-0@lo:103: Request processed in 122us (1364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123030.773563:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789123030.773578:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789123030.773589:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:3305:x1876031381190400:12345-0@lo:103: 00010000:00010000:0.0:1789123030.773601:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123030.773606:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f3400031c00/0x7e1648d68fc9191a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91913 expref: 13 pid: 5833 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.773616:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f3400031c00/0x7e1648d68fc9191a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc91913 expref: 13 pid: 5833 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.773644:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3400031c00/0x7e1648d68fc9191a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc91913 expref: 13 pid: 5833 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.773656:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f34029f2000/0x7e1648d68fc919c9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123030.773693:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381190272:0@lo:103: 00010000:00010000:0.0:1789123030.773748:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f34029f2000/0x7e1648d68fc919c9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.773766:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f34029f2000/0x7e1648d68fc919c9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.773773:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f34029f2000/0x7e1648d68fc919c9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.773780:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f34029f2000/0x7e1648d68fc919c9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.773795:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f34029f2000/0x7e1648d68fc919c9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.773801:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34029f2000 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:0.0:1789123030.773805:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f34029f2000/0x7e1648d68fc919c9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.773813:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f34029f2000/0x7e1648d68fc919c9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123030.776461:0:5833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f34029f2000/0x7e1648d68fc919c9 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123030.776478:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f34029f2000/0x7e1648d68fc919c9 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789123030.776487:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:0.0:1789123030.777248:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f34029f2000/0x7e1648d68fc919c9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.777261:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f34029f2000/0x7e1648d68fc919c9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.777291:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123030.777367:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:3305:x1876031381190400:12345-0@lo:103: Request processed in 3780us (4751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123030.777377:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789123030.777506:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381190400:0@lo:103: 00000100:00100000:1.0:1789123030.821297:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+11:7626:x1876031381189120:12345-0@lo:253: Request processed in 95931us (96143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123030.821316:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789123030.821423:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3405de3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381189120:0@lo:253: 10000000:01000000:3.0:1789123030.821441:0:7626:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789123030.821444:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789123030.821446:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789123030.821448:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789123030.821449:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1789123030.821451:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789123030.821452:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789123030.821454:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789123030.821455:0:7626:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789123030.821457:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789123030.821459:0:7626:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789123030.821480:0:7626:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f3406274800 from lustre-OST0001 10000000:01000000:3.0:1789123030.821504:0:7626:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789123030.821507:0:7626:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789123030.821515:0:7626:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f3407c54ed8 local copy 10000000:01000000:3.0:1789123030.821519:0:7626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789123030.821553:0:7626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc919d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123030.821563:0:7626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc919d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123030.821582:0:7626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc919d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123030.821599:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3405de3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381190528:0@lo:101: 00000100:00100000:3.0:1789123030.821655:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123030.821756:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34079039c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789123030.821816:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381190528 00000100:00100000:0.0:1789123030.821823:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381190528 00000100:00100000:0.0:1789123030.821864:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789123030.821873:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+11:7626:x1876031381190528:12345-0@lo:101: 00010000:00010000:0.0:1789123030.821883:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123030.821896:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3400031c00/0x7e1648d68fc919d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc919d0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.821918:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3400031c00/0x7e1648d68fc919d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc919d0 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.821936:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3400031c00/0x7e1648d68fc919d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc919d0 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.821945:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3400031c00, rc 0) 00000100:00100000:0.0:1789123030.821980:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:7626:x1876031381190528:12345-0@lo:101: Request processed in 109us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123030.821986:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789123030.822117:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3405de3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381190528:0@lo:101: 00010000:00010000:1.0:1789123030.822194:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc919d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x7e1648d68fc919d7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123030.822204:0:7626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc919d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7e1648d68fc919d7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123030.822299:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d49680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381190656:0@lo:501: 00000100:00100000:1.0:1789123030.822329:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123030.822390:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3403356840 going to sleep for 11 seconds 00000100:00100000:2.0:1789123030.822453:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381190656 00000100:00100000:2.0:1789123030.822458:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381190656 00000100:00100000:2.0:1789123030.822549:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789123030.822557:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:7626:x1876031381190656:12345-0@lo:501: 00000100:00100000:2.0:1789123030.822781:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:7626:x1876031381190656:12345-0@lo:501: Request processed in 225us (451us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789123030.822789:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789123030.822860:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d49680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381190656:0@lo:501: 10000000:01000000:1.0:1789123030.822876:0:7626:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789123030.822905:0:7626:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789123030.822911:0:7626:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc919d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7e1648d68fc919d7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123030.822920:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc919d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7e1648d68fc919d7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123030.822927:0:7626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc919d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7e1648d68fc919d7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123030.822952:0:7626:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789123030.822969:0:7626:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f3406274800 10000000:01000000:1.0:1789123030.822981:0:7626:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789123030.822986:0:7626:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789123030.822989:0:7626:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789123030.822993:0:7626:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789123030.823007:0:7626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789123030.823054:0:7626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34421d8000/0x7e1648d68fc919de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123030.823062:0:7626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f34421d8000/0x7e1648d68fc919de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123030.823070:0:7626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f34421d8000/0x7e1648d68fc919de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123030.823082:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d49680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381190784:0@lo:101: 00000100:00100000:1.0:1789123030.823107:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789123030.823157:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789123030.823163:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc919d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7e1648d68fc919d7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123030.823177:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401514a00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:3.0:1789123030.823181:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc919d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7e1648d68fc919d7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123030.823189:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc919d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x7e1648d68fc919d7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789123030.823201:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc919d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x7e1648d68fc919d7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789123030.823207:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789123030.823231:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc919d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7e1648d68fc919d7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123030.823250:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789123030.823268:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc919d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7e1648d68fc919d7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123030.823282:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc919d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7e1648d68fc919d7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123030.823300:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123030.823302:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123030.823303:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123030.823321:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3405de3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381190912:0@lo:103: 00000100:00100000:3.0:1789123030.823355:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123030.823417:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381190912 00000100:00100000:3.0:1789123030.823428:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381190912 00000100:00100000:3.0:1789123030.823462:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789123030.823469:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:3302:x1876031381190912:12345-0@lo:103: 00010000:00010000:3.0:1789123030.823480:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123030.823492:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3400031c00/0x7e1648d68fc919d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7e1648d68fc919d0 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123030.823505:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789123030.823532:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+11:3302:x1876031381190912:12345-0@lo:103: Request processed in 63us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123030.823538:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789123030.823566:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3405de3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381190912:0@lo:103: 00000100:00100000:1.0:1789123030.823848:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3403356d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789123030.823912:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381190784 00000100:00100000:0.0:1789123030.823917:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381190784 00000100:00100000:0.0:1789123030.823937:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789123030.823943:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+11:7626:x1876031381190784:12345-0@lo:101: 00010000:00010000:0.0:1789123030.823952:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123030.823962:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3400030200/0x7e1648d68fc919e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc919de expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.823977:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3400030200/0x7e1648d68fc919e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc919de expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.823986:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3400030200/0x7e1648d68fc919e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc919de expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.823994:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3400030200, rc 0) 00000100:00100000:0.0:1789123030.824069:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:7626:x1876031381190784:12345-0@lo:101: Request processed in 126us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123030.824076:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789123030.824233:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d49680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381190784:0@lo:101: 00010000:00010000:1.0:1789123030.824256:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f34421d8000/0x7e1648d68fc919de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc919e5 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123030.824264:0:7626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f34421d8000/0x7e1648d68fc919de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc919e5 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123030.824336:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d49680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381191040:0@lo:501: 00000100:00100000:1.0:1789123030.824361:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123030.824383:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3403356d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789123030.824433:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381191040 00000100:00100000:0.0:1789123030.824438:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381191040 00000100:00100000:0.0:1789123030.824455:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789123030.824470:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:7626:x1876031381191040:12345-0@lo:501: 00000100:00100000:0.0:1789123030.824677:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:7626:x1876031381191040:12345-0@lo:501: Request processed in 208us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123030.824684:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789123030.824757:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d49680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381191040:0@lo:501: 00000100:00100000:1.0:1789123030.824782:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d49680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381191168:0@lo:503: 00000100:00100000:1.0:1789123030.824818:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123030.824846:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3403356d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789123030.824892:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381191168 00000100:00100000:0.0:1789123030.824896:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381191168 00000100:00100000:0.0:1789123030.824912:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789123030.824917:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:7626:x1876031381191168:12345-0@lo:503: 00000100:00100000:0.0:1789123030.825050:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:7626:x1876031381191168:12345-0@lo:503: Request processed in 132us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123030.825056:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789123030.825193:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d49680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381191168:0@lo:503: 00000040:00080000:1.0:1789123030.825451:0:7626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789123030.825512:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d49680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381191296:0@lo:502: 00000100:00100000:1.0:1789123030.825548:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123030.825572:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3403356d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789123030.825652:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381191296 00000100:00100000:0.0:1789123030.825657:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381191296 00000100:00100000:0.0:1789123030.825679:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789123030.825685:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:7626:x1876031381191296:12345-0@lo:502: 00000100:00100000:0.0:1789123030.825811:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:7626:x1876031381191296:12345-0@lo:502: Request processed in 125us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123030.825818:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789123030.825903:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d49680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381191296:0@lo:502: 00000040:00080000:1.0:1789123030.826217:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789123030.826282:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789123030.826315:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789123030.826361:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789123030.826399:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789123030.826436:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789123030.826462:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d49680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381191424:0@lo:502: 00000100:00100000:1.0:1789123030.826501:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123030.826532:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3403356d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789123030.826593:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381191424 00000100:00100000:0.0:1789123030.826598:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381191424 00000100:00100000:0.0:1789123030.826621:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789123030.826655:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:7626:x1876031381191424:12345-0@lo:502: 00000100:00100000:0.0:1789123030.826781:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:7626:x1876031381191424:12345-0@lo:502: Request processed in 154us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123030.826788:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789123030.826874:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d49680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381191424:0@lo:502: 00000040:00080000:1.0:1789123030.826950:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789123030.826959:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1789123030.829707:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789123030.829717:0:7634:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789123030.829725:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123030.829727:0:7634:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789123030.829733:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789123030.829747:0:7634:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9f343bd03490) 00000020:00000080:3.0:1789123030.829782:0:7634:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789123030.829789:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789123030.829854:0:7634:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f3406274800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789123030.829865:0:7634:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789123030.829871:0:7634:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7e1648d68fc919f3 00010000:00010000:3.0:1789123030.833454:0:7634:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1789123030.833888:0:7634:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1789123030.836000:0:7634:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789123030.836368:0:7634:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1789123030.839926:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1789123030.840878:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1789123030.842358:0:7634:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789123030.842370:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789123030.842376:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789123030.842379:0:7634:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789123030.842383:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789123030.842386:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789123030.842388:0:7634:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789123030.842391:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789123030.842393:0:7634:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789123030.842433:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789123030.842437:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789123030.842438:0:7634:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789123030.842448:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789123030.844219:0:7626:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1789123030.844258:0:7626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789123030.844333:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34421d8000/0x7e1648d68fc919de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc919e5 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123030.844346:0:7626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f34421d8000/0x7e1648d68fc919de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc919e5 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123030.844362:0:7626:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f3406274800 from 1 10000000:01000000:2.0:1789123030.844365:0:7626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789123030.844398:0:7626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34029f2000/0x7e1648d68fc919fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123030.844405:0:7626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f34029f2000/0x7e1648d68fc919fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123030.844415:0:7626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f34029f2000/0x7e1648d68fc919fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123030.844434:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34356712c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381191552:0@lo:101: 00000100:00100000:2.0:1789123030.844497:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123030.844540:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340555a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123030.845102:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381191552 00000100:00100000:1.0:1789123030.845110:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381191552 00000100:00100000:1.0:1789123030.845163:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789123030.845172:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:7626:x1876031381191552:12345-0@lo:101: 00010000:00010000:1.0:1789123030.845185:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123030.845197:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f34421d9c00/0x7e1648d68fc91a01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc919fa expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123030.845219:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f34421d9c00/0x7e1648d68fc91a01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc919fa expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123030.845230:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f34421d9c00/0x7e1648d68fc91a01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc919fa expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123030.845247:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f34421d9c00, rc 0) 00000100:00100000:1.0:1789123030.845291:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:7626:x1876031381191552:12345-0@lo:101: Request processed in 121us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123030.845298:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789123030.845432:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34356712c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381191552:0@lo:101: 00010000:00010000:2.0:1789123030.845448:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f34029f2000/0x7e1648d68fc919fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91a01 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123030.845457:0:7626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f34029f2000/0x7e1648d68fc919fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91a01 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123030.845552:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34356712c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381191680:0@lo:501: 00000100:00100000:2.0:1789123030.845581:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123030.845611:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340555a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123030.846231:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381191680 00000100:00100000:1.0:1789123030.846247:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381191680 00000100:00100000:1.0:1789123030.846278:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789123030.846285:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:7626:x1876031381191680:12345-0@lo:501: 00000100:00100000:1.0:1789123030.846547:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:7626:x1876031381191680:12345-0@lo:501: Request processed in 261us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123030.846555:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789123030.846736:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34356712c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381191680:0@lo:501: 00000100:00100000:2.0:1789123030.846775:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34356712c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381191808:0@lo:503: 00000100:00100000:2.0:1789123030.846821:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123030.846888:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340555a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123030.850250:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381191808 00000100:00100000:1.0:1789123030.850262:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381191808 00000100:00100000:1.0:1789123030.850358:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789123030.850376:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:7626:x1876031381191808:12345-0@lo:503: 00000100:00100000:1.0:1789123030.850768:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:7626:x1876031381191808:12345-0@lo:503: Request processed in 393us (3945us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123030.850777:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789123030.850879:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34356712c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381191808:0@lo:503: 00000040:00080000:3.0:1789123030.851163:0:7626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789123030.851225:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3405de3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381191936:0@lo:502: 00000100:00100000:3.0:1789123030.851282:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123030.852147:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340622f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789123030.852290:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381191936 00000100:00100000:0.0:1789123030.852298:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381191936 00000100:00100000:0.0:1789123030.852339:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789123030.852347:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:7626:x1876031381191936:12345-0@lo:502: 00000100:00100000:0.0:1789123030.852557:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:7626:x1876031381191936:12345-0@lo:502: Request processed in 211us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123030.852565:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789123030.852686:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3405de3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381191936:0@lo:502: 00000040:00080000:3.0:1789123030.852953:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789123030.853004:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789123030.853033:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3405de3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381192064:0@lo:502: 00000100:00100000:3.0:1789123030.853080:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123030.853101:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340622f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789123030.853225:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381192064 00000100:00100000:0.0:1789123030.853230:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381192064 00000100:00100000:0.0:1789123030.853271:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789123030.853279:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:7626:x1876031381192064:12345-0@lo:502: 00000100:00100000:0.0:1789123030.853409:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:7626:x1876031381192064:12345-0@lo:502: Request processed in 130us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123030.853420:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789123030.853498:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3405de3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381192064:0@lo:502: 00000040:00080000:3.0:1789123030.853590:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789123030.853599:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789123030.855012:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789123030.855023:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789123030.855026:0:7638:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789123030.855033:0:7638:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f3406274800 00000020:00000080:0.0:1789123030.855035:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789123030.855054:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789123030.855057:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789123030.855059:0:7638:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789123030.855062:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789123030.855205:0:7626:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789123030.855228:0:7626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789123030.855289:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34029f2000/0x7e1648d68fc919fa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91a01 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123030.855300:0:7626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f34029f2000/0x7e1648d68fc919fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91a01 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123030.855340:0:7626:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789123030.855343:0:7626:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f3406274800 10000000:01000000:2.0:1789123030.855346:0:7626:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f3406274800 10000000:01000000:2.0:1789123030.855350:0:7626:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789123030.855355:0:7626:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f3406274800 from 1 10000000:01000000:2.0:1789123030.855358:0:7626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789123030.855388:0:7626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34029f3600/0x7e1648d68fc91a08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123030.855397:0:7626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f34029f3600/0x7e1648d68fc91a08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123030.855407:0:7626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f34029f3600/0x7e1648d68fc91a08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123030.855426:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34356730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381192192:0@lo:101: 00000100:00100000:2.0:1789123030.855480:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123030.855521:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340555a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789123030.855609:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381192192 00000100:00100000:3.0:1789123030.855615:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381192192 00000100:00100000:3.0:1789123030.855706:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789123030.855714:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:7626:x1876031381192192:12345-0@lo:101: 00010000:00010000:3.0:1789123030.855852:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123030.855875:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3401514a00/0x7e1648d68fc91a0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91a08 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123030.855898:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3401514a00/0x7e1648d68fc91a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91a08 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123030.855908:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3401514a00/0x7e1648d68fc91a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91a08 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123030.855916:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3401514a00, rc 0) 00000100:00100000:3.0:1789123030.855989:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:7626:x1876031381192192:12345-0@lo:101: Request processed in 275us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123030.855990:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34356730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381192192:0@lo:101: 00000100:00100000:3.0:1789123030.855996:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00010000:2.0:1789123030.856002:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f34029f3600/0x7e1648d68fc91a08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91a0f expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123030.856016:0:7626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f34029f3600/0x7e1648d68fc91a08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91a0f expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123030.856093:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34356730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381192320:0@lo:501: 00000100:00100000:2.0:1789123030.856119:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123030.856233:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340555a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789123030.856273:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381192320 00000100:00100000:3.0:1789123030.856278:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381192320 00000100:00100000:3.0:1789123030.856337:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789123030.856345:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:7626:x1876031381192320:12345-0@lo:501: 00000100:00100000:3.0:1789123030.856561:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:7626:x1876031381192320:12345-0@lo:501: Request processed in 217us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123030.856568:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789123030.856620:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34356730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381192320:0@lo:501: 00000100:00100000:2.0:1789123030.856670:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34356730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381192448:0@lo:503: 00000100:00100000:2.0:1789123030.856706:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123030.856893:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340555a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789123030.857101:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381192448 00000100:00100000:0.0:1789123030.857106:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381192448 00000100:00100000:0.0:1789123030.857138:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789123030.857147:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:7626:x1876031381192448:12345-0@lo:503: 00000100:00100000:0.0:1789123030.857340:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:7626:x1876031381192448:12345-0@lo:503: Request processed in 194us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123030.857347:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789123030.857458:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34356730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381192448:0@lo:503: 00000040:00080000:2.0:1789123030.858017:0:7626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789123030.858075:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34356730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381192576:0@lo:502: 00000100:00100000:2.0:1789123030.858117:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123030.858270:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381192576 00000100:00100000:0.0:1789123030.858281:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381192576 00000100:00100000:0.0:1789123030.858304:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789123030.858311:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:7626:x1876031381192576:12345-0@lo:502: 00000100:00100000:0.0:1789123030.858579:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:7626:x1876031381192576:12345-0@lo:502: Request processed in 268us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123030.858586:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789123030.858900:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340555a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789123030.858918:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34356730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381192576:0@lo:502: 00000040:00080000:2.0:1789123030.859247:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789123030.859302:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789123030.859338:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789123030.859389:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789123030.859426:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789123030.859475:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789123030.859512:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789123030.859542:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789123030.859598:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789123030.859846:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789123030.859891:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789123030.859939:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789123030.859975:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789123030.860001:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789123030.860044:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789123030.860079:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789123030.860113:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789123030.860251:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789123030.860293:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789123030.860329:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789123030.860377:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789123030.860416:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789123030.860452:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789123030.860501:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789123030.860539:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1789123030.860575:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1789123030.860823:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1789123030.860868:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1789123030.860905:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789123030.860954:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1789123030.860993:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1789123030.861027:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1789123030.861057:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1789123030.861096:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1789123030.861127:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1789123030.861259:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1789123030.861295:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1789123030.861335:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34356730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381192704:0@lo:502: 00000100:00100000:2.0:1789123030.861406:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123030.861507:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340555a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789123030.861547:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381192704 00000100:00100000:3.0:1789123030.861553:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381192704 00000100:00100000:3.0:1789123030.861656:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789123030.861666:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:7626:x1876031381192704:12345-0@lo:502: 00000100:00100000:3.0:1789123030.861877:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:7626:x1876031381192704:12345-0@lo:502: Request processed in 212us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123030.861885:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789123030.861982:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34356730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381192704:0@lo:502: 00000040:00080000:2.0:1789123030.862062:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1789123030.862072:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1789123030.862410:0:7639:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789123030.862424:0:7639:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9f34066a8000) 00000020:00000080:2.0:1789123030.862443:0:7639:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1789123030.862520:0:7639:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f3406274800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789123030.862525:0:7639:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f3406274800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789123030.862527:0:7639:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f3406274800 3 00010000:00080000:2.0:1789123030.862554:0:7639:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f3441fb8000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.130@tcp at head 00010000:00010000:2.0:1789123030.864149:0:7639:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1789123030.865973:0:7639:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789123030.866013:0:7639:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789123030.866024:0:7639:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x7e1648d68fc91a1d 00000100:00080000:0.0:1789123030.866034:0:7639:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789123030.866040:0:7639:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f3441fb8000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:0.0:1789123030.866071:0:7639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f3409cb4b40 x1876031381192832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789123030.866104:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1876031381192832:0@lo:38: 00000100:00100000:0.0:1789123030.866299:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789123030.866357:0:7639:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789123030.866426:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876031381192960:0@lo:400: 00000100:00100000:0.0:1789123030.866451:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123030.866483:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381193088:0@lo:400: 00000100:00100000:0.0:1789123030.866506:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123030.866525:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789123030.866531:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381193216:0@lo:400: 00000100:00100000:0.0:1789123030.866554:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123030.866584:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381192832 00000100:00100000:0.0:1789123030.866591:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381192832 00000100:00100000:0.0:1789123030.866610:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381192960 00000100:00100000:0.0:1789123030.866612:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381192960 00000100:00100000:0.0:1789123030.866666:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381193088 00000100:00100000:0.0:1789123030.866670:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381193088 00000100:00100000:0.0:1789123030.866697:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789123030.866705:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876031381192960:12345-0@lo:400: 00000100:00100000:1.0:1789123030.866815:0:5840:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789123030.866823:0:5840:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789123030.867198:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876031381192960:12345-0@lo:400: Request processed in 492us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123030.867207:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789123030.867225:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789123030.867232:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381193088:12345-0@lo:400: 00000100:00100000:0.0:1789123030.867287:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381193088:12345-0@lo:400: Request processed in 56us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123030.867293:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789123030.867304:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789123030.867308:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1876031381192832:12345-0@lo:38: 00010000:00080000:0.0:1789123030.867327:0:5842:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 145 last 0 00000020:00000080:0.0:1789123030.867370:0:5842:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x7e1648d68fc91a24 00000004:00100000:0.0:1789123030.867385:0:5842:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789123030.867415:0:5842:0:(import.c:65:import_set_state_nolock()) ffff9f343b9ae000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789123030.867455:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876031381192832:12345-0@lo:38: Request processed in 145us (1157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123030.867462:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789123030.867487:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381193216 00000100:00100000:0.0:1789123030.867491:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381193216 00000100:00100000:0.0:1789123030.867520:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789123030.867527:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381193216:12345-0@lo:400: 00000100:00100000:0.0:1789123030.867556:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381193216:12345-0@lo:400: Request processed in 30us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123030.867572:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789123030.867588:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789123030.867592:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789123030.867620:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f3409cb4b40 x1876031381192832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789123040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123030.867651:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789123030.867658:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789123030.867665:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789123030.867669:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789123030.867672:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9f3441fb8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789123030.867677:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1876031381192832:0@lo:38: 00000040:00080000:0.0:1789123030.867936:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1789123030.868064:0:7641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb4b40 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7641:1876031381193344:0@lo:901: 00000100:00100000:0.0:1789123030.868099:0:7641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123030.868207:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381193344 00000100:00100000:0.0:1789123030.868212:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381193344 00000100:00100000:0.0:1789123030.868257:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789123030.868265:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7641:x1876031381193344:12345-0@lo:901: 00000100:00100000:0.0:1789123030.868590:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7641:x1876031381193344:12345-0@lo:901: Request processed in 326us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123030.868597:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789123030.868614:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789123030.868690:0:7641:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3441ecb0c0 going to sleep for 11 seconds 00010000:00080000:0.0:1789123030.868708:0:7641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f3409cb4b40 x1876031381193344/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789123046 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000020:01000000:2.0:1789123030.868893:0:7626:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1789123030.868918:0:7626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789123030.868933:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34029f3600/0x7e1648d68fc91a08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91a0f expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123030.868944:0:7626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f34029f3600/0x7e1648d68fc91a08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91a0f expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789123030.868987:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789123030.868989:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789123030.868990:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789123030.868992:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789123030.868993:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789123030.868995:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789123030.868996:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789123030.868998:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789123030.868999:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789123030.869001:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789123030.869002:0:7626:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789123030.869006:0:7626:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1789123030.869008:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789123030.869010:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789123030.869011:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789123030.869018:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789123030.869020:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789123030.869021:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789123030.869022:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789123030.869023:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789123030.869024:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789123030.869025:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789123030.869026:0:7626:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789123030.869042:0:7626:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789123030.869052:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34356730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381193472:0@lo:253: 00000100:00100000:2.0:1789123030.869088:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123030.869116:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340555a300 going to sleep for 11 seconds 00000100:00100000:2.0:1789123030.869143:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381193472 00000100:00100000:2.0:1789123030.869147:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381193472 00000100:00100000:2.0:1789123030.869181:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789123030.869188:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:7626:x1876031381193472:12345-0@lo:253: 20000000:01000000:2.0:1789123030.869207:0:5833:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789123030.869218:0:5833:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789123030.871269:0:7641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb4b40 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7641:1876031381193344:0@lo:901: 00010000:00080000:1.0:1789123030.872106:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f3409cb7480 x1876031381193216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123030.872120:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381193216:0@lo:400: 00010000:00080000:1.0:1789123030.872142:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f3409cb6940 x1876031381193088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123030.872150:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381193088:0@lo:400: 00010000:00080000:3.0:1789123030.876662:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f3409cb61c0 x1876031381192960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123030.876693:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876031381192960:0@lo:400: 20000000:01000000:1.0:1789123030.900005:0:5833:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789123030.900025:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789123030.900090:0:5856:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789123030.900095:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789123030.900116:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f3401514c00/0x7e1648d68fc91a2b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123030.900145:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f3401515000/0x7e1648d68fc9197c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91975 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123030.900153:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f3401514c00/0x7e1648d68fc91a2b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123030.900192:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f3401515000/0x7e1648d68fc9197c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc91975 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123030.900207:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f3401515000/0x7e1648d68fc9197c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc91975 expref: 14 pid: 5833 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123030.900220:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3405de3c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1876031381193600:0@lo:104: 00000100:00100000:3.0:1789123030.900292:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123030.900352:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3407903600 going to sleep for 11 seconds 00000100:00100000:1.0:1789123030.901869:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381193600 00000100:00100000:1.0:1789123030.901882:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381193600 00000100:00100000:1.0:1789123030.901932:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789123030.901941:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:5856:x1876031381193600:12345-0@lo:104: 00010000:00010000:1.0:1789123030.901957:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f3400030800/0x7e1648d68fc91975 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc9197c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123030.902043:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789123030.902049:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:5856:x1876031381193600:12345-0@lo:104: Request processed in 109us (1757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123030.902056:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1789123030.902150:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789123030.902157:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f3400030800/0x7e1648d68fc91975 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc9197c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.902164:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3400030800 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:0.0:1789123030.902168:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f3400030800/0x7e1648d68fc91975 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc9197c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.902176:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f3400030800/0x7e1648d68fc91975 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc9197c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789123030.902182:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f3400030800/0x7e1648d68fc91975 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc9197c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789123030.902187:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789123030.902220:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f3400030800/0x7e1648d68fc91975 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc9197c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.902227:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789123030.902254:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f3400030800/0x7e1648d68fc91975 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc9197c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.902262:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f3400030800/0x7e1648d68fc91975 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc9197c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.902280:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123030.902282:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123030.902283:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123030.902296:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381193728:0@lo:103: 00000100:00100000:0.0:1789123030.902334:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123030.902390:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381193728 00000100:00100000:0.0:1789123030.902394:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381193728 00010000:00010000:0.0:1789123030.902413:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f3401515000/0x7e1648d68fc9197c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91975 expref: 15 pid: 5833 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123030.902436:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789123030.902443:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3406287850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:3302:x1876031381193728:12345-0@lo:103: 00010000:00010000:0.0:1789123030.902452:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123030.902457:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f3401515000/0x7e1648d68fc9197c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91975 expref: 15 pid: 5833 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.902467:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f3401515000/0x7e1648d68fc9197c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc91975 expref: 15 pid: 5833 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.902483:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f3401514c00/0x7e1648d68fc91a2b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.902491:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3401514c00/0x7e1648d68fc91a2b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789123030.902505:0:5825:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012851513s 00010000:00010000:0.0:1789123030.902509:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f3401514c00/0x7e1648d68fc91a2b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.902516:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f3401514c00/0x7e1648d68fc91a2b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.902522:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f3401514c00/0x7e1648d68fc91a2b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.902529:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f3401514c00/0x7e1648d68fc91a2b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.902544:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401514c00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:0.0:1789123030.902549:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f3401514c00/0x7e1648d68fc91a2b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.902556:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f3401514c00/0x7e1648d68fc91a2b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.902565:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f3401514c00/0x7e1648d68fc91a2b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123030.902574:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123030.902601:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3406287850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:3302:x1876031381193728:12345-0@lo:103: Request processed in 160us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123030.902608:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789123030.902694:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381193728:0@lo:103: 00010000:00010000:3.0:1789123030.902820:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3401515000/0x7e1648d68fc9197c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc91975 expref: 14 pid: 5833 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123030.902830:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3405de3c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1876031381193600:0@lo:104: 00010000:00010000:3.0:1789123030.902845:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f3401514c00/0x7e1648d68fc91a2b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123030.902853:0:5856:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f3401514c00/0x7e1648d68fc91a2b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123030.902865:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f3401514c00/0x7e1648d68fc91a2b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123030.902871:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3401514c00/0x7e1648d68fc91a2b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123030.910038:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:7626:x1876031381193472:12345-0@lo:253: Request processed in 40844us (40943us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123030.910071:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789123030.910223:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34356730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd41f4a0-f4e3-41a1-856e-0c34af912023:7626:1876031381193472:0@lo:253: 10000000:01000000:2.0:1789123030.910245:0:7626:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789123030.910249:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789123030.910250:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789123030.910252:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789123030.910253:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789123030.910254:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789123030.910255:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789123030.910257:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789123030.910259:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789123030.910260:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789123030.910262:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789123030.910263:0:7626:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789123030.910280:0:7626:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789123030.915612:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789123030.915853:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789123030.916080:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789123030.916332:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789123030.916607:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:3.0:1789123030.917045:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789123030.918284:0:7626:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789123031.162049:0:7626:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789123031.162057:0:7626:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789123031.162093:0:7626:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789123031.162162:0:7626:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.130@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789123031.162176:0:7626:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789123031.162200:0:7626:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1789123031.557022:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789123031.686294:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789123031.686301:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f343be04000 from 30 10000000:01000000:1.0:1789123031.686306:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789123031.686343:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34421d9800/0x7e1648d68fc91a32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123031.686355:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f34421d9800/0x7e1648d68fc91a32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123031.686365:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f34421d9800/0x7e1648d68fc91a32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123031.686387:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d49680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381193856:0@lo:101: 00000100:00100000:1.0:1789123031.686446:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123031.686497:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3403356900 going to sleep for 11 seconds 00000100:00100000:2.0:1789123031.686734:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381193856 00000100:00100000:2.0:1789123031.686740:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381193856 00000100:00100000:2.0:1789123031.686797:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789123031.686805:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:5838:x1876031381193856:12345-0@lo:101: 00010000:00010000:2.0:1789123031.686818:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123031.686829:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91a39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91a32 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123031.686850:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91a39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91a32 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123031.686860:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91a39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91a32 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123031.686868:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f34029f2e00, rc 0) 00000100:00100000:2.0:1789123031.686905:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:5838:x1876031381193856:12345-0@lo:101: Request processed in 101us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123031.686912:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789123031.687002:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d49680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381193856:0@lo:101: 00010000:00010000:1.0:1789123031.687018:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f34421d9800/0x7e1648d68fc91a32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91a39 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123031.687027:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f34421d9800/0x7e1648d68fc91a32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91a39 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123031.687075:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d49680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381193984:0@lo:501: 00000100:00100000:1.0:1789123031.687102:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123031.687134:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3403356900 going to sleep for 11 seconds 00000100:00100000:2.0:1789123031.687225:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381193984 00000100:00100000:2.0:1789123031.687230:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381193984 00000100:00100000:2.0:1789123031.687269:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789123031.687282:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:5838:x1876031381193984:12345-0@lo:501: 00000100:00100000:2.0:1789123031.687497:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:5838:x1876031381193984:12345-0@lo:501: Request processed in 215us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123031.687504:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789123031.687623:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d49680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381193984:0@lo:501: 00000100:00100000:1.0:1789123031.687683:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d49680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381194112:0@lo:503: 00000100:00100000:1.0:1789123031.687730:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123031.687749:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3403356900 going to sleep for 11 seconds 00000100:00100000:2.0:1789123031.687803:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381194112 00000100:00100000:2.0:1789123031.687808:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381194112 00000100:00100000:2.0:1789123031.687839:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789123031.687847:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:5838:x1876031381194112:12345-0@lo:503: 00000100:00100000:2.0:1789123031.688007:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:5838:x1876031381194112:12345-0@lo:503: Request processed in 160us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123031.688019:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789123031.688442:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d49680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381194112:0@lo:503: 00000100:00100000:2.0:1789123031.688981:0:7666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34356730c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:7666:1876031381194240:0@lo:502: 00000100:00100000:2.0:1789123031.689038:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123031.689062:0:7666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34365bdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123031.689519:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381194240 00000100:00100000:1.0:1789123031.689525:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381194240 00000100:00100000:1.0:1789123031.689566:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789123031.689574:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:7666:x1876031381194240:12345-0@lo:502: 00000100:00100000:1.0:1789123031.689830:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:7666:x1876031381194240:12345-0@lo:502: Request processed in 257us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123031.689838:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789123031.690603:0:7666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34356730c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:7666:1876031381194240:0@lo:502: 00000100:00100000:2.0:1789123031.690690:0:7666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34356730c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:7666:1876031381194368:0@lo:502: 00000100:00100000:2.0:1789123031.690737:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123031.690767:0:7666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34365bdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123031.690866:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381194368 00000100:00100000:1.0:1789123031.690872:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381194368 00000100:00100000:1.0:1789123031.690910:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789123031.690983:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:7666:x1876031381194368:12345-0@lo:502: 00000100:00100000:1.0:1789123031.692992:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:7666:x1876031381194368:12345-0@lo:502: Request processed in 2007us (2248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123031.693004:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789123031.698805:0:7666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34356730c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:7666:1876031381194368:0@lo:502: 00000040:00080000:0.0:1789123031.700747:0:7666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789123031.700905:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789123031.700926:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789123031.700937:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34421d9800/0x7e1648d68fc91a32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91a39 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123031.700949:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f34421d9800/0x7e1648d68fc91a32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91a39 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789123031.700958:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789123031.700960:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1789123031.700963:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789123031.701005:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34421d8c00/0x7e1648d68fc91a40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123031.701013:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f34421d8c00/0x7e1648d68fc91a40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123031.701022:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f34421d8c00/0x7e1648d68fc91a40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123031.701042:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d49680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381194496:0@lo:101: 00000100:00100000:1.0:1789123031.701102:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123031.701153:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3403356780 going to sleep for 11 seconds 00000100:00100000:3.0:1789123031.701399:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381194496 00000100:00100000:3.0:1789123031.701406:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381194496 00000100:00100000:3.0:1789123031.701451:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789123031.701462:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:5838:x1876031381194496:12345-0@lo:101: 00010000:00010000:3.0:1789123031.701474:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123031.701486:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3401514c00/0x7e1648d68fc91a47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91a40 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123031.701508:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3401514c00/0x7e1648d68fc91a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91a40 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123031.701526:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3401514c00/0x7e1648d68fc91a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91a40 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123031.701535:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3401514c00, rc 0) 00000100:00100000:3.0:1789123031.701667:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:5838:x1876031381194496:12345-0@lo:101: Request processed in 207us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123031.701675:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789123031.701862:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d49680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381194496:0@lo:101: 00010000:00010000:0.0:1789123031.701877:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f34421d8c00/0x7e1648d68fc91a40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91a47 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123031.701887:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f34421d8c00/0x7e1648d68fc91a40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91a47 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123031.701940:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381194624:0@lo:501: 00000100:00100000:0.0:1789123031.701969:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123031.702030:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3402da2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789123031.708805:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381194624 00000100:00100000:1.0:1789123031.708818:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381194624 00000100:00100000:1.0:1789123031.708880:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789123031.708891:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:5838:x1876031381194624:12345-0@lo:501: 00000100:00100000:1.0:1789123031.709853:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:5838:x1876031381194624:12345-0@lo:501: Request processed in 962us (7880us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123031.709863:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789123031.714346:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381194624:0@lo:501: 00000100:00100000:2.0:1789123031.714407:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435670000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381194752:0@lo:503: 00000100:00100000:2.0:1789123031.714479:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123031.714526:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34365bd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789123031.714701:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381194752 00000100:00100000:3.0:1789123031.714707:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381194752 00000100:00100000:3.0:1789123031.714752:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789123031.714761:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:5838:x1876031381194752:12345-0@lo:503: 00000100:00100000:3.0:1789123031.716016:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:5838:x1876031381194752:12345-0@lo:503: Request processed in 1251us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123031.716027:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789123031.718098:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435670000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381194752:0@lo:503: 00000100:00100000:1.0:1789123031.722421:0:7669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d4a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:7669:1876031381194880:0@lo:502: 00000100:00100000:1.0:1789123031.722511:0:7669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123031.722563:0:7669:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3403356540 going to sleep for 11 seconds 00000100:00100000:2.0:1789123031.722773:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381194880 00000100:00100000:2.0:1789123031.722780:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381194880 00000100:00100000:2.0:1789123031.722907:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789123031.722917:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:7669:x1876031381194880:12345-0@lo:502: 00000100:00100000:2.0:1789123031.723164:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:7669:x1876031381194880:12345-0@lo:502: Request processed in 248us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123031.723171:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789123031.723262:0:7669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d4a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:7669:1876031381194880:0@lo:502: 00000020:01000000:3.0:1789123031.723289:0:7669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789123031.723298:0:7669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123031.723300:0:7669:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789123031.723304:0:7669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789123031.723306:0:7669:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789123031.723324:0:7669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3405de3c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:7669:1876031381195008:0@lo:502: 00000100:00100000:3.0:1789123031.723360:0:7669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123031.723389:0:7669:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3441ecb600 going to sleep for 11 seconds 00000100:00100000:1.0:1789123031.723928:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381195008 00000100:00100000:1.0:1789123031.723934:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381195008 00000100:00100000:1.0:1789123031.723970:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789123031.723977:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:7669:x1876031381195008:12345-0@lo:502: 00000100:00100000:1.0:1789123031.724139:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:7669:x1876031381195008:12345-0@lo:502: Request processed in 162us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123031.724154:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789123031.724315:0:7669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3405de3c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:7669:1876031381195008:0@lo:502: 00000020:01000000:3.0:1789123031.724336:0:7669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789123031.724340:0:7669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123031.724347:0:7669:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789123031.724350:0:7669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1789123031.724450:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1789123031.724470:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789123031.724480:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34421d8c00/0x7e1648d68fc91a40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91a47 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123031.724490:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f34421d8c00/0x7e1648d68fc91a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91a47 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123031.724505:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789123031.724507:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f3408401800 from 30 10000000:01000000:2.0:1789123031.724510:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789123031.724536:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34029f2200/0x7e1648d68fc91a4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123031.724543:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f34029f2200/0x7e1648d68fc91a4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123031.724562:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f34029f2200/0x7e1648d68fc91a4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123031.724576:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435671a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381195136:0@lo:101: 00000100:00100000:2.0:1789123031.724607:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123031.724658:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34365bd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123031.727017:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381195136 00000100:00100000:1.0:1789123031.727028:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381195136 00000100:00100000:1.0:1789123031.727073:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789123031.727083:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:5838:x1876031381195136:12345-0@lo:101: 00010000:00010000:1.0:1789123031.727097:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123031.727112:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f34421d9400/0x7e1648d68fc91a55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91a4e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123031.727137:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f34421d9400/0x7e1648d68fc91a55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91a4e expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123031.727147:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f34421d9400/0x7e1648d68fc91a55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91a4e expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123031.727155:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f34421d9400, rc 0) 00000100:00100000:1.0:1789123031.727218:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:5838:x1876031381195136:12345-0@lo:101: Request processed in 136us (2609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123031.727225:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789123031.727286:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435671a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381195136:0@lo:101: 00010000:00010000:1.0:1789123031.727302:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f34029f2200/0x7e1648d68fc91a4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91a55 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123031.727311:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f34029f2200/0x7e1648d68fc91a4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91a55 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123031.727367:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381195264:0@lo:501: 00000100:00100000:1.0:1789123031.727396:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123031.727423:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3403356300 going to sleep for 11 seconds 00000100:00100000:1.0:1789123031.727436:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381195264 00000100:00100000:1.0:1789123031.727443:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381195264 00000100:00100000:1.0:1789123031.727463:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789123031.727469:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:5838:x1876031381195264:12345-0@lo:501: 00000100:00100000:1.0:1789123031.727711:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:5838:x1876031381195264:12345-0@lo:501: Request processed in 241us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123031.727718:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789123031.727747:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381195264:0@lo:501: 00000100:00100000:1.0:1789123031.727775:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381195392:0@lo:503: 00000100:00100000:1.0:1789123031.727808:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123031.727822:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3403356300 going to sleep for 11 seconds 00000100:00100000:1.0:1789123031.727833:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381195392 00000100:00100000:1.0:1789123031.727836:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381195392 00000100:00100000:1.0:1789123031.727857:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789123031.727863:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:5838:x1876031381195392:12345-0@lo:503: 00000100:00100000:1.0:1789123031.727993:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:5838:x1876031381195392:12345-0@lo:503: Request processed in 129us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123031.727999:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789123031.728034:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381195392:0@lo:503: 00000100:00100000:1.0:1789123031.728191:0:7670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d4a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:7670:1876031381195520:0@lo:502: 00000100:00100000:1.0:1789123031.728222:0:7670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123031.728256:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381195520 00000100:00100000:1.0:1789123031.728260:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381195520 00000100:00100000:1.0:1789123031.728282:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789123031.728287:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:7670:x1876031381195520:12345-0@lo:502: 00000100:00100000:1.0:1789123031.728435:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:7670:x1876031381195520:12345-0@lo:502: Request processed in 147us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123031.728441:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789123031.728468:0:7670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3403356f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789123031.728480:0:7670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d4a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:7670:1876031381195520:0@lo:502: 00000100:00100000:1.0:1789123031.728515:0:7670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d4a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:7670:1876031381195648:0@lo:502: 00000100:00100000:1.0:1789123031.728546:0:7670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123031.728564:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381195648 00000100:00100000:1.0:1789123031.728568:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381195648 00000100:00100000:1.0:1789123031.728586:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789123031.728592:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:7670:x1876031381195648:12345-0@lo:502: 00000100:00100000:1.0:1789123031.728729:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:7670:x1876031381195648:12345-0@lo:502: Request processed in 136us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123031.728736:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789123031.728764:0:7670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3403356f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789123031.728776:0:7670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d4a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:7670:1876031381195648:0@lo:502: 00000040:00080000:1.0:1789123031.728795:0:7670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789123031.728839:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789123031.728852:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789123031.728859:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34029f2200/0x7e1648d68fc91a4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91a55 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123031.728868:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f34029f2200/0x7e1648d68fc91a4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91a55 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789123031.728876:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789123031.728884:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f3408401800 from 5 10000000:01000000:1.0:1789123031.728887:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789123031.728908:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34421d9a00/0x7e1648d68fc91a5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123031.728915:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f34421d9a00/0x7e1648d68fc91a5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123031.728924:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f34421d9a00/0x7e1648d68fc91a5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123031.728937:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381195776:0@lo:101: 00000100:00100000:1.0:1789123031.728962:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123031.728975:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410b80240 going to sleep for 11 seconds 00000100:00100000:1.0:1789123031.728987:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381195776 00000100:00100000:1.0:1789123031.728991:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381195776 00000100:00100000:1.0:1789123031.729012:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789123031.729018:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:5838:x1876031381195776:12345-0@lo:101: 00010000:00010000:1.0:1789123031.729026:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123031.729048:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f343bd33a00/0x7e1648d68fc91a63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91a5c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123031.729066:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f343bd33a00/0x7e1648d68fc91a63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91a5c expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123031.729075:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f343bd33a00/0x7e1648d68fc91a63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91a5c expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123031.729082:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd33a00, rc 0) 00000100:00100000:1.0:1789123031.729112:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381195776:12345-0@lo:101: Request processed in 94us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123031.729124:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789123031.729156:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381195776:0@lo:101: 00010000:00010000:1.0:1789123031.729167:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f34421d9a00/0x7e1648d68fc91a5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91a63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123031.729176:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f34421d9a00/0x7e1648d68fc91a5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91a63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123031.729216:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381195904:0@lo:256: 00000100:00100000:1.0:1789123031.729261:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123031.729274:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410b80240 going to sleep for 11 seconds 00000100:00100000:1.0:1789123031.729285:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381195904 00000100:00100000:1.0:1789123031.729289:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381195904 00000100:00100000:1.0:1789123031.729309:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789123031.729315:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381195904:12345-0@lo:256: 20000000:01000000:1.0:1789123031.729326:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789123031.729343:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789123031.729346:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789123031.729423:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381195904:12345-0@lo:256: Request processed in 107us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123031.729429:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789123031.729454:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381195904:0@lo:256: 10000000:01000000:1.0:1789123031.729486:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789123031.729491:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34421d9a00/0x7e1648d68fc91a5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91a63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123031.729499:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f34421d9a00/0x7e1648d68fc91a5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91a63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789123031.729510:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789123031.729512:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1789123031.729514:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789123031.729529:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd33e00/0x7e1648d68fc91a6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123031.729536:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f343bd33e00/0x7e1648d68fc91a6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123031.729544:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f343bd33e00/0x7e1648d68fc91a6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123031.729553:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381196032:0@lo:101: 00000100:00100000:1.0:1789123031.729575:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123031.729588:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3403356000 going to sleep for 11 seconds 00000100:00100000:1.0:1789123031.729599:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381196032 00000100:00100000:1.0:1789123031.729603:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381196032 00000100:00100000:1.0:1789123031.729623:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789123031.729648:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381196032:12345-0@lo:101: 00010000:00010000:1.0:1789123031.729655:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123031.729662:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f343bd33200/0x7e1648d68fc91a71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91a6a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123031.729674:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f343bd33200/0x7e1648d68fc91a71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91a6a expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123031.729682:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f343bd33200/0x7e1648d68fc91a71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91a6a expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123031.729698:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd33200, rc 0) 00000100:00100000:1.0:1789123031.729727:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381196032:12345-0@lo:101: Request processed in 79us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123031.729733:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789123031.729762:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381196032:0@lo:101: 00010000:00010000:1.0:1789123031.729773:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f343bd33e00/0x7e1648d68fc91a6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91a71 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123031.729781:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f343bd33e00/0x7e1648d68fc91a6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91a71 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123031.729818:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381196160:0@lo:501: 00000100:00100000:1.0:1789123031.734833:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123031.738700:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381196160 00000100:00100000:2.0:1789123031.738713:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381196160 00000100:00100000:2.0:1789123031.739394:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789123031.739405:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381196160:12345-0@lo:501: 00000100:00100000:2.0:1789123031.739671:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381196160:12345-0@lo:501: Request processed in 268us (4842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123031.739679:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789123031.747700:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3403356000 going to sleep for 11 seconds 00000100:00100000:1.0:1789123031.747736:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381196160:0@lo:501: 00000100:00100000:1.0:1789123031.747784:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381196288:0@lo:503: 00000100:00100000:1.0:1789123031.747849:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123031.747883:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381196288 00000100:00100000:1.0:1789123031.747889:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381196288 00000100:00100000:1.0:1789123031.747931:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789123031.747940:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381196288:12345-0@lo:503: 00000100:00100000:1.0:1789123031.748187:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381196288:12345-0@lo:503: Request processed in 247us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123031.748195:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789123031.748248:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3403356000 going to sleep for 11 seconds 00000100:00100000:1.0:1789123031.748267:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d4a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381196288:0@lo:503: 00000100:00100000:1.0:1789123031.748425:0:7671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d4a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:7671:1876031381196416:0@lo:502: 00000100:00100000:1.0:1789123031.748456:0:7671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123031.748471:0:7671:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34184e6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789123031.748850:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381196416 00000100:00100000:2.0:1789123031.748856:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381196416 00000100:00100000:2.0:1789123031.748887:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789123031.748894:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:7671:x1876031381196416:12345-0@lo:502: 00000100:00100000:2.0:1789123031.749108:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:7671:x1876031381196416:12345-0@lo:502: Request processed in 214us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123031.749121:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789123031.749723:0:7671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d4a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:7671:1876031381196416:0@lo:502: 00000020:01000000:1.0:1789123031.749755:0:7671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789123031.749763:0:7671:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789123031.749770:0:7671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789123031.749772:0:7671:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789123031.749777:0:7671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789123031.749780:0:7671:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.130@tcp to nid 0x20000c0a8ce82 (192.168.206.130@tcp) 00000020:01000000:1.0:1789123031.749803:0:7671:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789123031.749806:0:7671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789123031.749820:0:7671:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9f3436568000) 00000020:00000080:1.0:1789123031.749840:0:7671:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789123031.749845:0:7671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789123031.749918:0:7671:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789123031.749923:0:7671:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789123031.749928:0:7671:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7e1648d68fc91a7f 00010000:00080000:1.0:1789123031.749955:0:7671:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f3406276800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.130@tcp at head 00010000:00010000:1.0:1789123031.751328:0:7671:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1789123031.751663:0:7671:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1789123031.751678:0:7671:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789123031.754111:0:7671:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789123031.754406:0:7671:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789123031.754453:0:7671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1789123031.754499:0:7671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1789123031.757320:0:7673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789123031.757328:0:7673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789123031.761613:0:7671:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789123031.761651:0:7671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789123031.762051:0:7671:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789123031.762073:0:7671:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7e1648d68fc91a86 00000100:00080000:2.0:1789123031.762083:0:7671:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789123031.762157:0:7671:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f3406276800 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:2.0:1789123031.762192:0:7671:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f3435670780 x1876031381196544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789123031.762220:0:7671:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1789123031.762276:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435670780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876031381196544:0@lo:8: 00000100:00100000:0.0:1789123031.762343:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123031.762436:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381196544 00000100:00100000:3.0:1789123031.762444:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381196544 00000100:00100000:3.0:1789123031.762479:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000020:01000000:2.0:1789123031.762482:0:7671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:3.0:1789123031.762488:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3301:x1876031381196544:12345-0@lo:8: 00000020:00000080:2.0:1789123031.762489:0:7671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789123031.762493:0:7671:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789123031.762497:0:7671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789123031.762513:0:7671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00010000:00080000:3.0:1789123031.762515:0:6687:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 146 last 0 00000020:00000080:2.0:1789123031.762516:0:7671:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789123031.762523:0:7671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789123031.762526:0:7671:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789123031.762553:0:7671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435673c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:7671:1876031381196672:0@lo:502: 00000020:00000080:3.0:1789123031.762555:0:6687:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7e1648d68fc91a8d 00002000:00100000:3.0:1789123031.762570:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9f3435929000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398a ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789123031.762574:0:6687:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1789123031.762577:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1789123031.762614:0:7671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123031.762664:0:7671:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3406558000 going to sleep for 11 seconds 00002000:00100000:3.0:1789123031.762722:0:6687:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789123031.762860:0:6687:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789123031.762881:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9f343592f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789123031.762932:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1876031381196544:12345-0@lo:8: Request processed in 444us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123031.762940:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789123031.762981:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3435670780 x1876031381196544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789123041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123031.762991:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789123031.762998:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789123031.763006:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789123031.763010:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789123031.763013:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9f3406276800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789123031.763031:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789123031.763035:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435670780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876031381196544:0@lo:8: 00000100:00100000:0.0:1789123031.763329:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876031381197184:0@lo:400: 00000100:00100000:0.0:1789123031.763362:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123031.763382:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789123031.763388:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381196800:0@lo:400: 00000100:00100000:0.0:1789123031.763409:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123031.763430:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381196928:0@lo:400: 00000100:00100000:0.0:1789123031.763465:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123031.763487:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789123031.763492:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381197056:0@lo:400: 00000100:00100000:0.0:1789123031.763514:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123031.763539:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381197184 00000100:00100000:1.0:1789123031.763608:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381196672 00000100:00100000:0.0:1789123031.763608:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381197184 00000100:00100000:1.0:1789123031.763615:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381196672 00000100:00100000:0.0:1789123031.763667:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381196800 00000100:00100000:0.0:1789123031.763671:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381196800 00000100:00100000:1.0:1789123031.763683:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789123031.763688:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381196928 00000100:00100000:0.0:1789123031.763691:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381196928 00000100:00100000:1.0:1789123031.763695:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:7671:x1876031381196672:12345-0@lo:502: 00000100:00100000:0.0:1789123031.763708:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789123031.763716:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876031381197184:12345-0@lo:400: 00000100:00100000:0.0:1789123031.763753:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876031381197184:12345-0@lo:400: Request processed in 37us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123031.763759:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789123031.763774:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789123031.763779:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381196800:12345-0@lo:400: 00000100:00100000:0.0:1789123031.763820:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381196800:12345-0@lo:400: Request processed in 41us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123031.763828:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789123031.763842:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789123031.763850:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381196928:12345-0@lo:400: 00000100:00100000:0.0:1789123031.763892:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381196928:12345-0@lo:400: Request processed in 43us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123031.763899:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789123031.763927:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381197056 00000100:00100000:0.0:1789123031.763931:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381197056 00000100:00100000:0.0:1789123031.763959:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789123031.763967:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381197056:12345-0@lo:400: 00000100:00100000:0.0:1789123031.763998:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381197056:12345-0@lo:400: Request processed in 32us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123031.764004:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789123031.764027:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:7671:x1876031381196672:12345-0@lo:502: Request processed in 335us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123031.764037:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:0.0:1789123031.764038:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3409cb70c0 x1876031381196800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123031.764051:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381196800:0@lo:400: 00010000:00080000:0.0:1789123031.764064:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3409cb61c0 x1876031381197184/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123031.764073:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876031381197184:0@lo:400: 00010000:00080000:0.0:1789123031.764100:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3409cb5e00 x1876031381197056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123031.764108:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381197056:0@lo:400: 00010000:00080000:0.0:1789123031.764118:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3409cb4780 x1876031381196928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123031.765371:0:7671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435673c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:7671:1876031381196672:0@lo:502: 00000020:01000000:2.0:1789123031.765401:0:7671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789123031.765408:0:7671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789123031.765410:0:7671:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789123031.765414:0:7671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1789123031.765470:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1789123031.765487:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789123031.765503:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd33e00/0x7e1648d68fc91a6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91a71 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123031.765514:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f343bd33e00/0x7e1648d68fc91a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91a71 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123031.765523:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789123031.765525:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f3407c54ed8 from 1 10000000:01000000:2.0:1789123031.765528:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:0.0:1789123031.765690:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381196928:0@lo:400: 00000004:00080000:0.0:1789123031.765719:0:7673:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789123031.765967:0:7673:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 146096338040ns, next at 0ns, rc = 0 00010000:00010000:2.0:1789123031.766475:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91a94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123031.766485:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91a94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123031.766494:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91a94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123031.766511:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435673c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381197312:0@lo:101: 00000100:00100000:2.0:1789123031.766649:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123031.766687:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408d2c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789123031.767961:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381197312 00000100:00100000:2.0:1789123031.767985:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381197312 00000100:00100000:2.0:1789123031.768032:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789123031.768041:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381197312:12345-0@lo:101: 00010000:00010000:2.0:1789123031.768056:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123031.768255:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f34029f2600/0x7e1648d68fc91a9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91a94 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123031.768281:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f34029f2600/0x7e1648d68fc91a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91a94 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123031.768300:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f34029f2600/0x7e1648d68fc91a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91a94 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123031.768309:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f34029f2600, rc 0) 00000100:00100000:2.0:1789123031.768362:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:5838:x1876031381197312:12345-0@lo:101: Request processed in 322us (1714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123031.768369:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789123031.768411:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435673c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381197312:0@lo:101: 00010000:00010000:2.0:1789123031.768424:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91a94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91a9b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123031.768433:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91a94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91a9b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123031.768478:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435673c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381197440:0@lo:501: 00000100:00100000:2.0:1789123031.768501:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123031.768522:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408d2c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789123031.768532:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381197440 00000100:00100000:2.0:1789123031.768535:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381197440 00000100:00100000:2.0:1789123031.768565:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789123031.768572:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:5838:x1876031381197440:12345-0@lo:501: 00000100:00100000:2.0:1789123031.768736:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:5838:x1876031381197440:12345-0@lo:501: Request processed in 164us (233us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789123031.768742:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789123031.768766:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435673c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381197440:0@lo:501: 10000000:01000000:2.0:1789123031.768782:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789123031.768792:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91a94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91a9b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123031.768800:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91a94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91a9b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123031.829099:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435673c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381197568:0@lo:13: 00000100:00100000:1.0:1789123031.829173:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789123031.829618:0:7674:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789123031.829656:0:7674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435673840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7674:1876031381197696:0@lo:7: 00000100:00100000:2.0:1789123031.829687:0:7674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123031.829702:0:7674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408d2c240 going to sleep for 11 seconds 00000100:00100000:3.0:1789123031.829889:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381197696 00000100:00100000:3.0:1789123031.829903:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381197696 00000100:00100000:3.0:1789123031.829971:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789123031.829983:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435672d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7674:x1876031381197696:12345-0@lo:7: 00000100:00080000:2.0:1789123031.831046:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789123031.831227:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381197568 00000100:00100000:1.0:1789123031.831244:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381197568 00000100:00100000:1.0:1789123031.831322:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789123031.831332:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d4a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1876031381197568:12345-0@lo:13: 00002000:00000024:1.0:1789123031.831350:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:1.0:1789123031.831412:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d4a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1876031381197568:12345-0@lo:13: Request processed in 82us (2237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123031.831420:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789123031.831510:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3435673c00 x1876031381197568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123047 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123031.831531:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435673c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381197568:0@lo:13: 00002000:00080000:3.0:1789123031.835758:0:6688:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1789123031.835766:0:6688:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789123031.835860:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435672d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7674:x1876031381197696:12345-0@lo:7: Request processed in 5877us (6168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123031.835870:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789123031.835889:0:7674:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3435673840 x1876031381197696/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789123047 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123031.835905:0:7674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435673840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7674:1876031381197696:0@lo:7: 00000004:00080000:1.0:1789123031.835921:0:7674:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789123031.835956:0:7674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d49680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7674:1876031381197824:0@lo:5: 00000100:00100000:1.0:1789123031.835990:0:7674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123031.836022:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381197824 00000100:00100000:3.0:1789123031.836029:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381197824 00000100:00100000:1.0:1789123031.836029:0:7674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3406282600 going to sleep for 11 seconds 00000100:00100000:3.0:1789123031.836067:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789123031.836076:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d48f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7674:x1876031381197824:12345-0@lo:5: 00002000:00080000:3.0:1789123031.836099:0:6687:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789123031.836103:0:6687:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1789123031.836427:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d48f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7674:x1876031381197824:12345-0@lo:5: Request processed in 352us (436us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789123031.836435:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789123031.836667:0:7674:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3409d49680 x1876031381197824/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789123047 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123031.836679:0:7674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d49680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7674:1876031381197824:0@lo:5: 00000004:00080000:1.0:1789123031.836688:0:7674:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789123031.836712:0:7674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d4a1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7674:1876031381197952:0@lo:700: 00000100:00100000:1.0:1789123031.836737:0:7674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123031.836760:0:7674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3406282600 going to sleep for 11 seconds 00000100:00100000:2.0:1789123031.836834:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381197952 00000100:00100000:2.0:1789123031.836839:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381197952 00000100:00100000:2.0:1789123031.836878:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789123031.836885:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7674:x1876031381197952:12345-0@lo:700: 00000100:00100000:2.0:1789123031.836912:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34356721c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6694:1876031381198080:0@lo:700: 00000100:00100000:2.0:1789123031.836942:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123031.836969:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3441ecb540 going to sleep for 11 seconds 00000100:00100000:1.0:1789123031.837030:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381198080 00000100:00100000:1.0:1789123031.837035:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381198080 00000100:00100000:1.0:1789123031.837061:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789123031.837067:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435670f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6694:x1876031381198080:12345-0@lo:700: 00000004:00080000:1.0:1789123031.856097:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:0.0:1789123031.913458:0:5847:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1789123031.916792:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435670f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6694:x1876031381198080:12345-0@lo:700: Request processed in 79717us (79840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123031.916805:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789123031.917024:0:6694:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34356721c0 x1876031381198080/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789123047 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123031.917038:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34356721c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6694:1876031381198080:0@lo:700: 40000000:02000000:0.0:1789123031.917050:0:6694:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:0.0:1789123031.998862:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7674:x1876031381197952:12345-0@lo:700: Request processed in 161970us (162116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123031.998877:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:1.0:1789123031.998949:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1789123031.998959:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:2.0:1789123031.998976:0:7674:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3409d4a1c0 x1876031381197952/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789123047 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123031.998992:0:7674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d4a1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7674:1876031381197952:0@lo:700: 00000004:02000040:2.0:1789123032.033751:0:7674:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1789123032.039251:0:7674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435670b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7674:1876031381198208:0@lo:5: 00000100:00100000:2.0:1789123032.039316:0:7674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123032.040159:0:7674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34184e6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789123032.040216:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381198208 00000100:00100000:0.0:1789123032.040223:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381198208 00000100:00100000:0.0:1789123032.040285:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789123032.040295:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435671680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7674:x1876031381198208:12345-0@lo:5: 00002000:00080000:0.0:1789123032.049049:0:6688:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1789123032.049067:0:6688:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1789123032.057823:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435671680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7674:x1876031381198208:12345-0@lo:5: Request processed in 17523us (18501us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789123032.057851:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789123032.057944:0:7674:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3435670b40 x1876031381198208/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789123048 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123032.057960:0:7674:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789123032.057975:0:7674:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9f3435670b40 x1876031381198208/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789123048 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123032.057986:0:7674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435670b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7674:1876031381198208:0@lo:5: 00000004:00080000:3.0:1789123032.057999:0:7674:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1789123032.580866:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123033.605995:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381198336:0@lo:13: 00000100:00100000:1.0:1789123033.606063:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123033.606136:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381198336 00000100:00100000:1.0:1789123033.606143:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381198336 00000100:00100000:1.0:1789123033.606206:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789123033.606215:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381198336:12345-0@lo:13: 00002000:00000024:1.0:1789123033.606256:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789123033.606298:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381198336:12345-0@lo:13: Request processed in 84us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123033.606305:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789123033.606343:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34184c8000 x1876031381198336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123033.606374:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381198336:0@lo:13: 00010000:00010000:3.0:1789123033.606456:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789123033.607159:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789123034.629758:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123035.655416:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123036.677723:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123037.189525:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381198464:0@lo:400: 00000100:00100000:0.0:1789123037.189589:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123037.195935:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381198848:0@lo:400: 00000100:00100000:0.0:1789123037.196003:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123037.196059:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381198592:0@lo:400: 00000100:00100000:0.0:1789123037.196084:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123037.196107:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381199104:0@lo:400: 00000100:00100000:0.0:1789123037.196130:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123037.196158:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789123037.196576:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381198720:0@lo:400: 00000100:00100000:0.0:1789123037.196603:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123037.196651:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381198464 00000100:00100000:0.0:1789123037.196659:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381198464 00000100:00100000:0.0:1789123037.196697:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789123037.196706:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3305:x1876031381198464:12345-0@lo:400: 00000100:00100000:0.0:1789123037.196853:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3305:x1876031381198464:12345-0@lo:400: Request processed in 147us (7262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123037.196861:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789123037.196901:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381198848 00000100:00100000:0.0:1789123037.196905:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381198848 00000100:00100000:0.0:1789123037.196938:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381199104 00000100:00100000:0.0:1789123037.196941:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381199104 00000100:00100000:0.0:1789123037.196958:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789123037.196963:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184c8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381198848:12345-0@lo:400: 00000100:00100000:0.0:1789123037.196999:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184c8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381198848:12345-0@lo:400: Request processed in 35us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123037.197005:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789123037.197017:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789123037.197029:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184cb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1876031381199104:12345-0@lo:400: 00000100:00100000:0.0:1789123037.197059:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184cb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1876031381199104:12345-0@lo:400: Request processed in 31us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123037.197065:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789123037.197083:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381198592 00000100:00100000:0.0:1789123037.197086:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381198592 00000100:00100000:0.0:1789123037.197116:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381198720 00000100:00100000:0.0:1789123037.197119:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381198720 00000100:00100000:0.0:1789123037.197139:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789123037.197145:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381198592:12345-0@lo:400: 00000100:00100000:0.0:1789123037.197292:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381198592:12345-0@lo:400: Request processed in 147us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123037.197299:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789123037.197311:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789123037.197318:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381198720:12345-0@lo:400: 00000100:00100000:0.0:1789123037.197344:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381198720:12345-0@lo:400: Request processed in 27us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123037.197349:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1789123037.212565:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789123037.212572:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789123037.212575:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789123037.212622:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34184c92c0 x1876031381198848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123037.212657:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381198848:0@lo:400: 00010000:00080000:0.0:1789123037.212693:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34184ca580 x1876031381198720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123037.212702:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381198720:0@lo:400: 00000100:00100000:1.0:1789123037.213724:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381198464:0@lo:400: 00000100:00100000:1.0:1789123037.213737:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381198976:0@lo:400: 00000100:00100000:1.0:1789123037.213795:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123037.213903:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381198976 00000100:00100000:2.0:1789123037.213909:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381198976 00000100:00100000:2.0:1789123037.213957:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789123037.213967:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876031381198976:12345-0@lo:400: 00000100:00100000:2.0:1789123037.214051:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876031381198976:12345-0@lo:400: Request processed in 86us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123037.214058:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789123037.214118:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34184cb480 x1876031381198976/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123037.214129:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381198976:0@lo:400: 00010000:00080000:0.0:1789123037.214367:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34184cb0c0 x1876031381198592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123037.214379:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381198592:0@lo:400: 00010000:00080000:0.0:1789123037.214443:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34184c9a40 x1876031381199104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123037.214454:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381199104:0@lo:400: 00000100:00100000:0.0:1789123037.214470:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789123037.214476:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3405de0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381199232:0@lo:13: 00000100:00100000:0.0:1789123037.215095:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789123037.215186:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789123037.215232:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381199232 00000100:00100000:0.0:1789123037.215238:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381199232 00000100:00100000:0.0:1789123037.215274:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789123037.215281:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1876031381199232:12345-0@lo:13: 00002000:00000024:0.0:1789123037.215309:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789123037.215346:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1876031381199232:12345-0@lo:13: Request processed in 65us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123037.215353:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789123037.215383:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3405de0b40 x1876031381199232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123053 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123037.215399:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3405de0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381199232:0@lo:13: 00000001:00080000:1.0:1789123037.257548:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:02000400:3.0:1789123037.691357:0:7991:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789123037.700830:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123038.727642:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789123038.727666:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381199360:0@lo:13: 00000100:00100000:1.0:1789123038.727732:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123038.727795:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381199360 00000100:00100000:1.0:1789123038.727801:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381199360 00000100:00100000:1.0:1789123038.727841:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789123038.727850:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381199360:12345-0@lo:13: 00002000:00000024:1.0:1789123038.727882:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789123038.727923:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d48b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381199360:12345-0@lo:13: Request processed in 74us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123038.727931:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789123038.727968:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3409d4a1c0 x1876031381199360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123038.727986:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381199360:0@lo:13: 00010000:00010000:2.0:1789123038.732157:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123039.748792:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123040.776327:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123041.799211:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123042.309343:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34356703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381199488:0@lo:13: 00000100:00100000:2.0:1789123042.309408:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123042.309473:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381199488 00000100:00100000:2.0:1789123042.309480:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381199488 00000100:00100000:2.0:1789123042.309523:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789123042.309533:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435671e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381199488:12345-0@lo:13: 00002000:00000024:2.0:1789123042.309562:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123042.309597:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435671e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381199488:12345-0@lo:13: Request processed in 67us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123042.309604:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1789123042.309620:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789123042.309678:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34356703c0 x1876031381199488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123058 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123042.309688:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789123042.309704:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34356703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381199488:0@lo:13: 00000100:00100000:3.0:1789123042.310839:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3405de1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381199616:0@lo:400: 00000100:00100000:3.0:1789123042.310882:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123042.310906:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3405de0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876031381200128:0@lo:400: 00000100:00100000:3.0:1789123042.310931:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123042.310949:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789123042.310954:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3405de1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381199744:0@lo:400: 00000100:00100000:3.0:1789123042.310972:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123042.310997:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381200128 00000100:00100000:3.0:1789123042.311002:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381200128 00000100:00100000:3.0:1789123042.311035:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381199744 00000100:00100000:3.0:1789123042.311038:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381199744 00000100:00100000:3.0:1789123042.311054:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789123042.311061:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876031381200128:12345-0@lo:400: 00000100:00100000:3.0:1789123042.311110:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876031381200128:12345-0@lo:400: Request processed in 49us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123042.311117:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789123042.311130:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789123042.311136:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381199744:12345-0@lo:400: 00000100:00100000:3.0:1789123042.311163:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381199744:12345-0@lo:400: Request processed in 27us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123042.311168:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789123042.311203:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3405de03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381199872:0@lo:400: 00000100:00100000:3.0:1789123042.311225:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123042.311241:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789123042.311255:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3405de0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381200000:0@lo:400: 00000100:00100000:3.0:1789123042.311286:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123042.311309:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381200000 00000100:00100000:3.0:1789123042.311313:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381200000 00000100:00100000:3.0:1789123042.311339:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789123042.311346:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381200000:12345-0@lo:400: 00000100:00100000:3.0:1789123042.311380:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381200000:12345-0@lo:400: Request processed in 35us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123042.311387:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789123042.311575:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789123042.311579:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789123042.311600:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3405de0f00 x1876031381200000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123042.311611:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3405de0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381200000:0@lo:400: 00010000:00080000:3.0:1789123042.311657:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3405de1e00 x1876031381199744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123042.311667:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3405de1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381199744:0@lo:400: 00010000:00080000:3.0:1789123042.311676:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3405de0b40 x1876031381200128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123042.311685:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3405de0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876031381200128:0@lo:400: 00000100:00100000:3.0:1789123042.311705:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381199872 00000100:00100000:3.0:1789123042.311708:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381199872 00000100:00100000:3.0:1789123042.311730:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789123042.311736:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381199872:12345-0@lo:400: 00000100:00100000:3.0:1789123042.311764:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381199872:12345-0@lo:400: Request processed in 29us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123042.311769:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1789123042.311789:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789123042.311807:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3405de03c0 x1876031381199872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123042.311817:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3405de03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381199872:0@lo:400: 00000100:00100000:2.0:1789123042.314524:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381199616 00000100:00100000:2.0:1789123042.314532:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381199616 00000100:00100000:2.0:1789123042.314570:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789123042.314579:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3302:x1876031381199616:12345-0@lo:400: 00000100:00100000:2.0:1789123042.314666:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3302:x1876031381199616:12345-0@lo:400: Request processed in 88us (3783us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123042.314674:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789123042.314691:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3405de1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381199616:0@lo:400: 00010000:00010000:3.0:1789123042.822217:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123043.200203:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123043.200343:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364399232 00000100:00100000:3.0:1789123043.200352:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364399232 00000100:00100000:3.0:1789123043.200393:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 111 00000100:00100000:3.0:1789123043.200401:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2351:x1876031364399232:12345-192.168.206.30@tcp:250: 00010000:00080000:3.0:1789123043.200424:0:5835:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 19924a15-1c73-4644-a9ca-864666412d45@192.168.206.30@tcp t0 exp 0000000000000000 cur 157 last 0 00000020:00000080:3.0:1789123043.200447:0:5835:0:(genops.c:1385:class_connect()) connect: client 19924a15-1c73-4644-a9ca-864666412d45, cookie 0x7e1648d68fc91aa2 00000100:00080000:3.0:1789123043.200576:0:5835:0:(import.c:65:import_set_state_nolock()) ffff9f3435929800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789123043.200648:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+5:2351:x1876031364399232:12345-192.168.206.30@tcp:250: Request processed in 227us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123043.200655:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 111 00000100:00100000:3.0:1789123043.208393:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123043.208959:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364399360 00000100:00100000:2.0:1789123043.208968:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364399360 00000100:00100000:2.0:1789123043.209023:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 112 00000100:00100000:2.0:1789123043.209031:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+5:5578:x1876031364399360:12345-192.168.206.30@tcp:101: 00010000:00010000:2.0:1789123043.209045:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123043.209059:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f342d80b200/0x7e1648d68fc91aa9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f415 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123043.209088:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f342d80b200/0x7e1648d68fc91aa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f415 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123043.209100:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f342d80b200/0x7e1648d68fc91aa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f415 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123043.209119:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80b200, rc 0) 00000100:00100000:2.0:1789123043.209178:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+6:5578:x1876031364399360:12345-192.168.206.30@tcp:101: Request processed in 139us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123043.209186:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 112 00000100:00100000:0.0:1789123043.227903:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123043.227973:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364399488 00000100:00100000:3.0:1789123043.227990:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364399488 00000100:00100000:3.0:1789123043.228034:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 113 00000100:00100000:3.0:1789123043.228043:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+6:5578:x1876031364399488:12345-192.168.206.30@tcp:501: 00000100:00100000:3.0:1789123043.228551:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+6:5578:x1876031364399488:12345-192.168.206.30@tcp:501: Request processed in 507us (655us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789123043.228559:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 113 00000100:00100000:0.0:1789123043.233948:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123043.234349:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364399616 00000100:00100000:3.0:1789123043.234358:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364399616 00000100:00100000:3.0:1789123043.234407:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 114 00000100:00100000:3.0:1789123043.234415:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+6:5578:x1876031364399616:12345-192.168.206.30@tcp:101: 00010000:00010000:3.0:1789123043.234436:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123043.234452:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3401515000/0x7e1648d68fc91ab0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f41c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123043.234475:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3401515000/0x7e1648d68fc91ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f41c expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123043.234952:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3401515000/0x7e1648d68fc91ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f41c expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123043.234962:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3401515000, rc 0) 00000100:00100000:3.0:1789123043.235020:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+7:5578:x1876031364399616:12345-192.168.206.30@tcp:101: Request processed in 605us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123043.235027:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 114 00000100:00100000:0.0:1789123043.245743:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123043.245830:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364399744 00000100:00100000:1.0:1789123043.245843:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364399744 00000100:00100000:1.0:1789123043.245886:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 115 00000100:00100000:1.0:1789123043.245894:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+7:5578:x1876031364399744:12345-192.168.206.30@tcp:501: 00000100:00100000:1.0:1789123043.246151:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+8:5578:x1876031364399744:12345-192.168.206.30@tcp:501: Request processed in 257us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123043.246159:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 115 00000100:00100000:0.0:1789123043.255451:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123043.256165:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364399872 00000100:00100000:3.0:1789123043.256184:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364399872 00000100:00100000:3.0:1789123043.256240:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 116 00000100:00100000:3.0:1789123043.256251:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+8:5578:x1876031364399872:12345-192.168.206.30@tcp:503: 00000100:00100000:3.0:1789123043.256602:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+8:5578:x1876031364399872:12345-192.168.206.30@tcp:503: Request processed in 352us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123043.256610:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 116 00000100:00100000:2.0:1789123043.281575:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123043.281682:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364400000 00000100:00100000:0.0:1789123043.281690:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364400000 00000100:00100000:0.0:1789123043.281736:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 117 00000100:00100000:0.0:1789123043.281745:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+8:5597:x1876031364400000:12345-192.168.206.30@tcp:502: 00000100:00100000:0.0:1789123043.282027:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+8:5597:x1876031364400000:12345-192.168.206.30@tcp:502: Request processed in 283us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123043.282035:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 117 00000100:00100000:1.0:1789123043.358704:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123043.358965:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364400128 00000100:00100000:3.0:1789123043.359607:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364400128 00000100:00100000:3.0:1789123043.359676:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 118 00000100:00100000:3.0:1789123043.359685:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+8:5597:x1876031364400128:12345-192.168.206.30@tcp:502: 00000100:00100000:3.0:1789123043.364306:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+8:5597:x1876031364400128:12345-192.168.206.30@tcp:502: Request processed in 4612us (5599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123043.364334:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 118 00000100:00100000:0.0:1789123043.378388:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123043.379215:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364400256 00000100:00100000:2.0:1789123043.379224:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364400256 00000100:00100000:2.0:1789123043.379288:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 119 00000100:00100000:2.0:1789123043.379296:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+8:5578:x1876031364400256:12345-192.168.206.30@tcp:101: 00010000:00010000:2.0:1789123043.379310:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123043.379326:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f342d80a000/0x7e1648d68fc91ab7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f446 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123043.379352:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f342d80a000/0x7e1648d68fc91ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f446 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123043.379365:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f342d80a000/0x7e1648d68fc91ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f446 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123043.379375:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80a000, rc 0) 00000100:00100000:2.0:1789123043.379424:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+9:5578:x1876031364400256:12345-192.168.206.30@tcp:101: Request processed in 128us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123043.379431:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 119 00000100:00100000:2.0:1789123043.389001:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123043.392133:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364400384 00000100:00100000:3.0:1789123043.392154:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364400384 00000100:00100000:3.0:1789123043.392240:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 120 00000100:00100000:3.0:1789123043.392252:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+9:5578:x1876031364400384:12345-192.168.206.30@tcp:256: 20000000:01000000:3.0:1789123043.392284:0:5834:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789123043.392308:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789123043.392313:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789123043.392317:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789123043.392320:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1789123043.397739:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+9:5578:x1876031364400384:12345-192.168.206.30@tcp:256: Request processed in 5472us (8737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123043.397757:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 120 00000100:00100000:3.0:1789123043.406860:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123043.409067:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364400512 00000100:00100000:1.0:1789123043.409086:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364400512 00000100:00100000:1.0:1789123043.409708:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 121 00000100:00100000:1.0:1789123043.409725:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+9:5578:x1876031364400512:12345-192.168.206.30@tcp:101: 00010000:00010000:1.0:1789123043.409749:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123043.409774:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f343bd32400/0x7e1648d68fc91abe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f44d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123043.409813:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f343bd32400/0x7e1648d68fc91abe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f44d expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123043.409827:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f343bd32400/0x7e1648d68fc91abe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f44d expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123043.409838:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd32400, rc 0) 00000100:00100000:1.0:1789123043.409925:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+10:5578:x1876031364400512:12345-192.168.206.30@tcp:101: Request processed in 206us (3080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123043.409933:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 121 00000100:00100000:0.0:1789123043.412952:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123043.415431:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364400640 00000100:00100000:3.0:1789123043.415451:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364400640 00000100:00100000:3.0:1789123043.415547:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 122 00000100:00100000:3.0:1789123043.415559:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+10:5578:x1876031364400640:12345-192.168.206.30@tcp:501: 00000100:00100000:3.0:1789123043.416003:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+10:5578:x1876031364400640:12345-192.168.206.30@tcp:501: Request processed in 445us (3063us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123043.416013:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 122 00000100:00100000:1.0:1789123043.418390:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123043.421054:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364400768 00000100:00100000:0.0:1789123043.421072:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364400768 00000100:00100000:0.0:1789123043.421242:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 123 00000100:00100000:0.0:1789123043.421255:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+10:5578:x1876031364400768:12345-192.168.206.30@tcp:503: 00000100:00100000:0.0:1789123043.421713:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+10:5578:x1876031364400768:12345-192.168.206.30@tcp:503: Request processed in 459us (3342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123043.421723:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 123 00000100:00100000:2.0:1789123043.436884:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123043.438846:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364400896 00000100:00100000:3.0:1789123043.438863:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364400896 00000100:00100000:3.0:1789123043.438952:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 124 00000100:00100000:3.0:1789123043.438963:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+10:5601:x1876031364400896:12345-192.168.206.30@tcp:502: 00000100:00100000:3.0:1789123043.439365:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+10:5601:x1876031364400896:12345-192.168.206.30@tcp:502: Request processed in 402us (2506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123043.439938:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 124 00000100:00100000:3.0:1789123043.451991:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123043.454549:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364401024 00000100:00100000:0.0:1789123043.454568:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364401024 00000100:00100000:0.0:1789123043.454657:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 125 00000100:00100000:0.0:1789123043.454668:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+10:5601:x1876031364401024:12345-192.168.206.30@tcp:502: 00000100:00100000:0.0:1789123043.454963:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+10:5601:x1876031364401024:12345-192.168.206.30@tcp:502: Request processed in 294us (2981us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123043.454982:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 125 00000100:00100000:1.0:1789123043.465146:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123043.466142:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364401152 00000100:00100000:3.0:1789123043.466157:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364401152 00000100:00100000:3.0:1789123043.466223:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 4 00000100:00100000:3.0:1789123043.466233:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2351:x1876031364401152:12345-192.168.206.30@tcp:38: 00010000:00080000:3.0:1789123043.466269:0:5842:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 64de9449-4320-4c9f-abcb-230edd2b11ae@192.168.206.30@tcp t0 exp 0000000000000000 cur 157 last 0 00000020:00000080:3.0:1789123043.466330:0:5842:0:(genops.c:1385:class_connect()) connect: client 64de9449-4320-4c9f-abcb-230edd2b11ae, cookie 0x7e1648d68fc91ac5 00000004:00100000:3.0:1789123043.466375:0:5842:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1789123043.466384:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1789123043.481217:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123043.481262:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364401536 00000100:00100000:0.0:1789123043.481275:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364401536 00000100:00100000:0.0:1789123043.481336:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 126 00000100:00100000:0.0:1789123043.481348:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+10:2354:x1876031364401536:12345-192.168.206.30@tcp:400: 00000100:00100000:0.0:1789123043.481611:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+10:2354:x1876031364401536:12345-192.168.206.30@tcp:400: Request processed in 264us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123043.481621:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 126 00000100:00080000:2.0:1789123043.520008:0:5842:0:(import.c:65:import_set_state_nolock()) ffff9f343bd29800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789123043.520126:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2351:x1876031364401152:12345-192.168.206.30@tcp:38: Request processed in 53891us (54992us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123043.520139:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 4 00010000:00010000:3.0:1789123043.844822:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123043.845293:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789123043.845321:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3405de03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381200256:0@lo:13: 00000100:00100000:3.0:1789123043.845431:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123043.845518:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381200256 00000100:00100000:3.0:1789123043.845528:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381200256 00000100:00100000:3.0:1789123043.845587:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789123043.845598:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381200256:12345-0@lo:13: 00002000:00000024:3.0:1789123043.845660:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789123043.845707:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381200256:12345-0@lo:13: Request processed in 110us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123043.845714:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789123043.845757:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3405de03c0 x1876031381200256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123043.845775:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3405de03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381200256:0@lo:13: 00000100:00100000:0.0:1789123044.527573:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123044.527727:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364401280 00000100:00100000:3.0:1789123044.527740:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364401280 00000100:00100000:3.0:1789123044.527838:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 5 00000100:00100000:3.0:1789123044.527852:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+6:0:x1876031364401280:12345-192.168.206.30@tcp:41: 00000004:00000024:3.0:1789123044.527938:0:7640:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789123044.528044:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+6:0:x1876031364401280:12345-192.168.206.30@tcp:41: Request processed in 195us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123044.528053:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 5 00000100:00080000:0.0:1789123044.528303:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789123044.530528:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123044.530714:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364401408 00000100:00100000:0.0:1789123044.530725:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364401408 00000100:00100000:0.0:1789123044.530796:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 6 00000100:00100000:0.0:1789123044.530807:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+6:5578:x1876031364401408:12345-192.168.206.30@tcp:41: 00000004:00000024:0.0:1789123044.530847:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789123044.530944:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+6:5578:x1876031364401408:12345-192.168.206.30@tcp:41: Request processed in 139us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123044.530952:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 6 00000100:00100000:2.0:1789123044.534729:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123044.537492:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364401664 00000100:00100000:3.0:1789123044.537513:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364401664 00000100:00100000:3.0:1789123044.537615:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:3.0:1789123044.537686:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34356703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+6:5578:x1876031364401664:12345-192.168.206.30@tcp:40: 00000100:00100000:3.0:1789123044.537825:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34356703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+6:5578:x1876031364401664:12345-192.168.206.30@tcp:40: Request processed in 198us (3112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123044.537833:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:3.0:1789123044.546814:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123044.546936:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123044.546972:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123044.547008:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123044.547045:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364401792 00000100:00100000:3.0:1789123044.547064:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364401792 00000100:00100000:3.0:1789123044.547107:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364401920 00000100:00100000:3.0:1789123044.547110:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364401920 00000100:00100000:3.0:1789123044.547125:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 8 00000100:00100000:3.0:1789123044.547135:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1876031364401792:12345-192.168.206.30@tcp:8: 00010000:00080000:3.0:1789123044.547185:0:6687:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 64de9449-4320-4c9f-abcb-230edd2b11ae@192.168.206.30@tcp t0 exp 0000000000000000 cur 158 last 0 00000020:00000080:3.0:1789123044.547227:0:6687:0:(genops.c:1385:class_connect()) connect: client 64de9449-4320-4c9f-abcb-230edd2b11ae, cookie 0x7e1648d68fc91acc 00002000:00100000:3.0:1789123044.547242:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 64de9449-4320-4c9f-abcb-230edd2b11ae/ffff9f343592b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789123044.547257:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789123044.547741:0:6687:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789123044.547788:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9f3435928800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789123044.547878:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2351:x1876031364401792:12345-192.168.206.30@tcp:8: Request processed in 742us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123044.547888:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 8 00000100:00100000:3.0:1789123044.547914:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00100000:3.0:1789123044.547920:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1876031364401920:12345-192.168.206.30@tcp:8: 00010000:00080000:3.0:1789123044.547938:0:6687:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 64de9449-4320-4c9f-abcb-230edd2b11ae@192.168.206.30@tcp t0 exp 0000000000000000 cur 158 last 0 00000020:00000080:3.0:1789123044.547959:0:6687:0:(genops.c:1385:class_connect()) connect: client 64de9449-4320-4c9f-abcb-230edd2b11ae, cookie 0x7e1648d68fc91ad3 00002000:00100000:3.0:1789123044.547965:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 64de9449-4320-4c9f-abcb-230edd2b11ae/ffff9f3301273000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789123044.547986:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789123044.548231:0:6687:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789123044.548248:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9f3301276000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789123044.548272:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2351:x1876031364401920:12345-192.168.206.30@tcp:8: Request processed in 351us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123044.548279:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00100000:0.0:1789123044.550052:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364402176 00000100:00100000:0.0:1789123044.550072:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364402176 00000100:00100000:0.0:1789123044.550152:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 127 00000100:00100000:0.0:1789123044.550175:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+10:2355:x1876031364402176:12345-192.168.206.30@tcp:400: 00000100:00100000:0.0:1789123044.550270:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+10:2355:x1876031364402176:12345-192.168.206.30@tcp:400: Request processed in 107us (3333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123044.550299:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 127 00000100:00100000:2.0:1789123044.562743:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364402048 00000100:00100000:2.0:1789123044.562766:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364402048 00000100:00100000:2.0:1789123044.563622:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 0 00000100:00100000:2.0:1789123044.563665:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+6:5578:x1876031364402048:12345-192.168.206.30@tcp:33: 00000004:00080000:3.0:1789123044.601750:0:5843:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 37983us 00000004:00200000:3.0:1789123044.612451:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1789123044.612702:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+6:5578:x1876031364402048:12345-192.168.206.30@tcp:33: Request processed in 49036us (65898us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123044.612723:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 0 00000100:00100000:3.0:1789123044.783673:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123044.783767:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364402304 00000100:00100000:0.0:1789123044.783776:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364402304 00000100:00100000:0.0:1789123044.783836:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 8 00000100:00100000:0.0:1789123044.783846:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+6:5619:x1876031364402304:12345-192.168.206.30@tcp:101: 00010000:00010000:0.0:1789123044.783864:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123044.784151:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3400030c00/0x7e1648d68fc91ada lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f477 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123044.784226:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3400030400/0x7e1648d68fc91ae1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123044.784463:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3400030400/0x7e1648d68fc91ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123044.784481:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3400030400/0x7e1648d68fc91ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123044.793695:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1789123044.793705:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789123044.793855:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3400030400/0x7e1648d68fc91ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123044.793961:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3400030c00/0x7e1648d68fc91ada lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f477 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123044.794048:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3400030400/0x7e1648d68fc91ae1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f477 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123044.794057:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34226c1d00) 00010000:00010000:1.0:1789123044.794295:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789123044.794300:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3400030400, rc 0) 00000100:00100000:1.0:1789123044.794441:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+7:5619:x1876031364402304:12345-192.168.206.30@tcp:101: Request processed in 10594us (10823us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123044.794450:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 8 00010000:00010000:3.0:1789123044.871119:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123045.893651:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789123046.476264:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 64de9449-4320-4c9f-abcb-230edd2b11ae 00010000:00010000:3.0:1789123046.923521:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123047.144457:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123047.144556:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364402432 00000100:00100000:3.0:1789123047.144578:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364402432 00000100:00100000:3.0:1789123047.144683:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00100000:3.0:1789123047.144696:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+7:5671:x1876031364402432:12345-192.168.206.30@tcp:41: 00000004:00000024:3.0:1789123047.144745:0:7640:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789123047.144840:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+7:5671:x1876031364402432:12345-192.168.206.30@tcp:41: Request processed in 148us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123047.144848:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00080000:0.0:1789123047.145476:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789123047.151531:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123047.151664:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364402560 00000100:00100000:2.0:1789123047.151674:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364402560 00000100:00100000:2.0:1789123047.151805:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 8 00000100:00100000:2.0:1789123047.151816:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:64de9449-4320-4c9f-abcb-230edd2b11ae+5:5671:x1876031364402560:12345-192.168.206.30@tcp:13: 00002000:00000024:2.0:1789123047.151857:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123047.151933:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:64de9449-4320-4c9f-abcb-230edd2b11ae+5:5671:x1876031364402560:12345-192.168.206.30@tcp:13: Request processed in 118us (410us total) trans 0 rc 0/0 00000100:00080000:0.0:1789123047.151935:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789123047.151941:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 8 00000100:00100000:2.0:1789123047.168816:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123047.169020:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364402688 00000100:00100000:3.0:1789123047.169030:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364402688 00000100:00100000:3.0:1789123047.169240:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00100000:3.0:1789123047.169253:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435670b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:64de9449-4320-4c9f-abcb-230edd2b11ae+6:5671:x1876031364402688:12345-192.168.206.30@tcp:13: 00002000:00000024:3.0:1789123047.169291:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789123047.169363:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435670b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:64de9449-4320-4c9f-abcb-230edd2b11ae+6:5671:x1876031364402688:12345-192.168.206.30@tcp:13: Request processed in 113us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123047.169370:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00080000:0.0:1789123047.169821:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789123047.430401:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34356721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381200384:0@lo:13: 00000100:00100000:3.0:1789123047.430471:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123047.431092:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184c8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876031381200768:0@lo:400: 00000100:00100000:1.0:1789123047.431131:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123047.431174:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789123047.431180:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876031381200640:0@lo:400: 00000100:00100000:1.0:1789123047.431204:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123047.431235:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381200768 00000100:00100000:1.0:1789123047.431241:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381200768 00000100:00100000:1.0:1789123047.431304:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381200640 00000100:00100000:1.0:1789123047.431308:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381200640 00000100:00100000:1.0:1789123047.431328:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789123047.431336:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409c99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876031381200768:12345-0@lo:400: 00000100:00100000:1.0:1789123047.431403:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409c99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876031381200768:12345-0@lo:400: Request processed in 67us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123047.431424:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789123047.431441:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789123047.431448:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409c9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876031381200640:12345-0@lo:400: 00000100:00100000:1.0:1789123047.431479:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409c9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876031381200640:12345-0@lo:400: Request processed in 32us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123047.431485:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1789123047.431505:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789123047.431534:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876031381200640:0@lo:400: 00000100:00100000:1.0:1789123047.431545:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184c8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876031381200768:0@lo:400: 00000100:00100000:1.0:1789123047.431569:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381200896:0@lo:400: 00000100:00100000:1.0:1789123047.431596:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123047.431615:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789123047.431621:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381200512:0@lo:400: 00000100:00100000:1.0:1789123047.432084:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123047.432112:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876031381201024:0@lo:400: 00000100:00100000:1.0:1789123047.432137:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123047.432175:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381201024 00000100:00100000:1.0:1789123047.432179:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381201024 00000100:00100000:1.0:1789123047.432209:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789123047.432216:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409c98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876031381201024:12345-0@lo:400: 00000100:00100000:1.0:1789123047.432252:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409c98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876031381201024:12345-0@lo:400: Request processed in 36us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123047.432258:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789123047.432285:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789123047.432305:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876031381201024:0@lo:400: 00000100:00100000:2.0:1789123047.432424:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381200384 00000100:00100000:2.0:1789123047.432429:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381200384 00000100:00100000:2.0:1789123047.432472:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789123047.432478:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381200384:12345-0@lo:13: 00002000:00000024:2.0:1789123047.432859:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123047.433285:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381200384:12345-0@lo:13: Request processed in 805us (2812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123047.433294:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789123047.433335:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34356721c0 x1876031381200384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123047.433352:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34356721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381200384:0@lo:13: 00000100:00100000:0.0:1789123047.433490:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381200512 00000100:00100000:0.0:1789123047.433500:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381200512 00000100:00100000:0.0:1789123047.433542:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789123047.433550:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3304:x1876031381200512:12345-0@lo:400: 00000100:00100000:0.0:1789123047.433593:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3304:x1876031381200512:12345-0@lo:400: Request processed in 44us (1923us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123047.433598:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789123047.433618:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381200896 00000100:00100000:3.0:1789123047.433623:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381200896 00000100:00100000:3.0:1789123047.433871:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789123047.433892:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409c9b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381200896:12345-0@lo:400: 00000100:00080000:1.0:1789123047.433949:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789123047.433953:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789123047.434172:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409c9b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381200896:12345-0@lo:400: Request processed in 281us (2574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123047.434179:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789123047.434548:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381200512:0@lo:400: 00010000:00080000:2.0:1789123047.434564:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34184c8b40 x1876031381200896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123047.434585:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381200896:0@lo:400: 00010000:00010000:3.0:1789123047.947190:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123048.964812:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789123048.964849:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3405de1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381201152:0@lo:13: 00000100:00100000:0.0:1789123048.964914:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123048.964998:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381201152 00000100:00100000:3.0:1789123048.965006:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381201152 00000100:00100000:3.0:1789123048.965084:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789123048.965093:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381201152:12345-0@lo:13: 00002000:00000024:3.0:1789123048.965125:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789123048.965189:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381201152:12345-0@lo:13: Request processed in 96us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123048.965197:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1789123048.965342:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3405de1680 x1876031381201152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123048.965360:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3405de1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381201152:0@lo:13: 00010000:00010000:2.0:1789123048.966207:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789123049.061336:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 64de9449-4320-4c9f-abcb-230edd2b11ae 00000001:00100000:1.0:1789123049.606591:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 64de9449-4320-4c9f-abcb-230edd2b11ae 00000100:00100000:1.0:1789123049.899883:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123049.899920:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123049.899953:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123049.899982:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123049.900011:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364402816 00000100:00100000:1.0:1789123049.900021:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364402816 00000100:00100000:1.0:1789123049.900095:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 129 00000100:00100000:1.0:1789123049.900105:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+10:2353:x1876031364402816:12345-192.168.206.30@tcp:400: 00000100:00100000:1.0:1789123049.900184:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+10:2353:x1876031364402816:12345-192.168.206.30@tcp:400: Request processed in 80us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123049.900191:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 129 00000100:00100000:2.0:1789123049.900363:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364402944 00000100:00100000:2.0:1789123049.900369:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364402944 00000100:00100000:2.0:1789123049.900652:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 22 00000100:00100000:2.0:1789123049.900662:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409c9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2353:x1876031364402944:12345-192.168.206.30@tcp:400: 00000100:00100000:2.0:1789123049.900702:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409c9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2353:x1876031364402944:12345-192.168.206.30@tcp:400: Request processed in 43us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123049.900710:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 22 00000100:00100000:2.0:1789123049.902080:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364403200 00000100:00100000:2.0:1789123049.902093:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364403200 00000100:00100000:3.0:1789123049.904743:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364403072 00000100:00100000:3.0:1789123049.904758:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364403072 00000100:00080000:1.0:1789123049.907726:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789123049.907740:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789123049.908841:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:2.0:1789123049.908858:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409c98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2353:x1876031364403200:12345-192.168.206.30@tcp:400: 00000100:00100000:2.0:1789123049.908943:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409c98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2353:x1876031364403200:12345-192.168.206.30@tcp:400: Request processed in 91us (9022us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123049.908951:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:3.0:1789123049.910541:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 8 00000100:00100000:3.0:1789123049.910556:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409c98f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2353:x1876031364403072:12345-192.168.206.30@tcp:400: 00000100:00100000:3.0:1789123049.910699:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409c98f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2353:x1876031364403072:12345-192.168.206.30@tcp:400: Request processed in 146us (10714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123049.910707:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 8 00000100:00080000:1.0:1789123049.910999:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789123049.989606:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789123050.759205:0:8299:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789123051.016181:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123052.038251:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123052.549060:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876031381201408:0@lo:400: 00000100:00100000:0.0:1789123052.549061:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876031381201536:0@lo:400: 00000100:00100000:1.0:1789123052.549141:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184c8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876031381201792:0@lo:400: 00000100:00100000:3.0:1789123052.549167:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789123052.549187:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381201664:0@lo:400: 00000100:00100000:2.0:1789123052.549489:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123052.549787:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381201920:0@lo:400: 00000100:00100000:2.0:1789123052.549823:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123052.549882:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381201408 00000100:00100000:2.0:1789123052.549893:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381201408 00000100:00100000:2.0:1789123052.549961:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789123052.549976:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34356721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876031381201408:12345-0@lo:400: 00000100:00100000:1.0:1789123052.549976:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123052.550050:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34356721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876031381201408:12345-0@lo:400: Request processed in 79us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123052.550058:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789123052.550094:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381201792 00000100:00100000:1.0:1789123052.550213:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876031381201408:0@lo:400: 00000100:00100000:0.0:1789123052.550737:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123052.550807:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381201536 00000100:00100000:1.0:1789123052.550812:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381201536 00000100:00100000:1.0:1789123052.550854:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789123052.550861:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876031381201536:12345-0@lo:400: 00000100:00100000:1.0:1789123052.550911:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876031381201536:12345-0@lo:400: Request processed in 51us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123052.551004:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876031381201536:0@lo:400: 00000100:00100000:1.0:1789123052.551056:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1789123052.551091:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789123052.551210:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381201792 00000100:00100000:2.0:1789123052.551360:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789123052.551369:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3420dbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876031381201792:12345-0@lo:400: 00000100:00100000:2.0:1789123052.551415:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3420dbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876031381201792:12345-0@lo:400: Request processed in 47us (1442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123052.551421:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789123052.551491:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381201920 00000100:00100000:2.0:1789123052.551496:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381201920 00000100:00080000:1.0:1789123052.551564:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789123052.551568:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789123052.551679:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789123052.551700:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435673840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381201920:12345-0@lo:400: 00000100:00100000:2.0:1789123052.551749:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435673840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381201920:12345-0@lo:400: Request processed in 62us (1923us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123052.551757:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789123052.551823:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123052.551855:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381201280:0@lo:400: 00000100:00100000:3.0:1789123052.551894:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123052.552923:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381201664 00000100:00100000:0.0:1789123052.552939:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381201664 00000100:00100000:3.0:1789123052.552942:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381201280 00000100:00100000:3.0:1789123052.552949:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381201280 00000100:00100000:3.0:1789123052.553097:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789123052.553108:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3302:x1876031381201280:12345-0@lo:400: 00000100:00100000:1.0:1789123052.553329:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789123052.553339:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d56d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381201664:12345-0@lo:400: 00000100:00100000:3.0:1789123052.553395:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3302:x1876031381201280:12345-0@lo:400: Request processed in 289us (1499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123052.553397:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d56d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381201664:12345-0@lo:400: Request processed in 59us (1578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123052.553413:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789123052.553413:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789123052.553467:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789123052.553489:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34184cb480 x1876031381201664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123052.553506:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381201664:0@lo:400: 00000100:00100000:3.0:1789123052.553518:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381201280:0@lo:400: 00000100:00100000:2.0:1789123052.554369:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184c8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876031381201792:0@lo:400: 00010000:00080000:2.0:1789123052.554413:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34184ca1c0 x1876031381201920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123052.554425:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381201920:0@lo:400: 00000100:00100000:2.0:1789123052.554437:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789123052.554448:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435673c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381202048:0@lo:13: 00000100:00100000:2.0:1789123052.554499:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123052.555925:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381202048 00000100:00100000:1.0:1789123052.555937:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381202048 00000100:00100000:1.0:1789123052.556035:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789123052.556047:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435670780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381202048:12345-0@lo:13: 00002000:00000024:1.0:1789123052.556098:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789123052.556195:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435670780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381202048:12345-0@lo:13: Request processed in 150us (1696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123052.556203:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1789123052.556769:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3435673c00 x1876031381202048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123068 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123052.556795:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435673c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381202048:0@lo:13: 00010000:00010000:1.0:1789123053.061508:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123054.084951:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123054.085178:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789123054.085200:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381202176:0@lo:13: 00000100:00100000:0.0:1789123054.085264:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123054.085436:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381202176 00000100:00100000:2.0:1789123054.085443:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381202176 00000100:00100000:2.0:1789123054.085511:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789123054.085528:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381202176:12345-0@lo:13: 00002000:00000024:2.0:1789123054.085571:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123054.085665:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381202176:12345-0@lo:13: Request processed in 144us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123054.085673:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789123054.085710:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3409d55680 x1876031381202176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123054.085728:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381202176:0@lo:13: 00000100:00080000:1.0:1789123054.085863:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1789123054.570883:0:8446:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd7315c760 20000000:00000080:1.0:1789123054.570901:0:8446:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f34355ab000 uarg=0000000000000000 20000000:01000000:1.0:1789123054.570937:0:8446:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1789123054.570940:0:8446:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1789123054.570943:0:8446:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789123054.570947:0:8446:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789123054.570952:0:8446:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1789123054.570965:0:8446:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789123054.570968:0:8446:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789123054.572320:0:8446:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789123054.572325:0:8446:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789123054.574483:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1789123054.575173:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1789123054.575238:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1789123054.575295:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1789123054.575308:0:8446:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789123054.575311:0:8446:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789123054.576256:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1789123054.576827:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1789123054.577205:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1789123054.577251:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1789123054.577265:0:8446:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789123054.577267:0:8446:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789123054.578747:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1789123054.579507:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1789123054.579575:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1789123054.579615:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1789123054.579778:0:8446:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789123054.579782:0:8446:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789123054.581198:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1789123054.581828:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1789123054.582331:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1789123054.582374:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:1.0:1789123054.582391:0:8446:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789123054.582410:0:8446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f343bd32800/0x7e1648d68fc91ae8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.582554:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f3400030200/0x7e1648d68fc919e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc919de expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.582564:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f3401514a00/0x7e1648d68fc91a0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91a08 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.582572:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91a39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91a32 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.582578:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f3401514c00/0x7e1648d68fc91a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91a40 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.582598:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f34421d9400/0x7e1648d68fc91a55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91a4e expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.582604:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f343bd33200/0x7e1648d68fc91a71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91a6a expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.582610:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f34029f2600/0x7e1648d68fc91a9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91a94 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.582620:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f342d80b200/0x7e1648d68fc91aa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f415 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.582862:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f3401515000/0x7e1648d68fc91ab0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f41c expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.582870:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f343bd32800/0x7e1648d68fc91ae8 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.582924:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f3401515000/0x7e1648d68fc91ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f41c expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.582939:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f3401515000/0x7e1648d68fc91ab0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f41c expref: 9 pid: 5835 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123054.582954:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a6940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876031381202304:192.168.206.30@tcp:104: 00010000:00010000:1.0:1789123054.583271:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f342d80b200/0x7e1648d68fc91aa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f415 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.583280:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f342d80b200/0x7e1648d68fc91aa9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f415 expref: 9 pid: 5834 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123054.583297:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a70c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876031381202432:192.168.206.30@tcp:104: 00010000:00010000:1.0:1789123054.583335:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f34029f2600/0x7e1648d68fc91a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc91a94 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.583344:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f34029f2600/0x7e1648d68fc91a9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc91a94 expref: 18 pid: 5833 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123054.583353:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a6580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876031381202560:0@lo:104: 00000100:00100000:1.0:1789123054.583391:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789123054.583475:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f343bd33200/0x7e1648d68fc91a71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc91a6a expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.583492:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f343bd33200/0x7e1648d68fc91a71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc91a6a expref: 18 pid: 5834 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123054.583501:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876031381202688:0@lo:104: 00000100:00100000:1.0:1789123054.583528:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789123054.586387:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f34421d9400/0x7e1648d68fc91a55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc91a4e expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.586404:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f34421d9400/0x7e1648d68fc91a55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc91a4e expref: 18 pid: 5833 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123054.586416:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a5a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876031381202816:0@lo:104: 00010000:00010000:1.0:1789123054.586462:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f3401514c00/0x7e1648d68fc91a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc91a40 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.586470:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f3401514c00/0x7e1648d68fc91a47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc91a40 expref: 18 pid: 5835 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123054.586504:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a4780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876031381202944:0@lo:104: 00010000:00010000:1.0:1789123054.586534:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91a39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc91a32 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.586541:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91a39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc91a32 expref: 18 pid: 5834 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123054.586548:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876031381203072:0@lo:104: 00010000:00010000:1.0:1789123054.586571:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f3401514a00/0x7e1648d68fc91a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc91a08 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.586580:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f3401514a00/0x7e1648d68fc91a0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc91a08 expref: 18 pid: 5833 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123054.586587:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a7840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876031381203200:0@lo:104: 00010000:00010000:1.0:1789123054.586609:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f3400030200/0x7e1648d68fc919e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc919de expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.586617:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f3400030200/0x7e1648d68fc919e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc919de expref: 18 pid: 5835 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123054.586645:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a6d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876031381203328:0@lo:104: 00000100:00100000:1.0:1789123054.586675:0:8446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f343c34f540 going to sleep for 11 seconds 00000100:00100000:1.0:1789123054.587234:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123054.587307:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123054.587645:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a6940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876031381202304:192.168.206.30@tcp:104: 00000100:00100000:3.0:1789123054.587659:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a70c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876031381202432:192.168.206.30@tcp:104: 00000100:00100000:1.0:1789123054.587729:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364403328 00000100:00100000:1.0:1789123054.587736:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364403328 00010000:00010000:1.0:1789123054.587780:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f3401515000/0x7e1648d68fc91ab0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f41c expref: 10 pid: 5835 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123054.587815:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364403456 00000100:00100000:1.0:1789123054.587819:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364403456 00010000:00010000:1.0:1789123054.587832:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f342d80b200/0x7e1648d68fc91aa9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f415 expref: 11 pid: 5834 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123054.587845:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 12 00000100:00100000:1.0:1789123054.587854:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19924a15-1c73-4644-a9ca-864666412d45+11:2355:x1876031364403328:12345-192.168.206.30@tcp:103: 00010000:00010000:1.0:1789123054.587865:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123054.587870:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f3401515000/0x7e1648d68fc91ab0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f41c expref: 11 pid: 5835 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.587880:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f3401515000/0x7e1648d68fc91ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f41c expref: 11 pid: 5835 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.587897:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3401515000/0x7e1648d68fc91ab0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f41c expref: 11 pid: 5835 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.587911:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789123054.587953:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19924a15-1c73-4644-a9ca-864666412d45+10:2355:x1876031364403328:12345-192.168.206.30@tcp:103: Request processed in 100us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123054.587961:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 12 00000100:00100000:1.0:1789123054.587978:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 13 00000100:00100000:1.0:1789123054.587985:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19924a15-1c73-4644-a9ca-864666412d45+9:2354:x1876031364403456:12345-192.168.206.30@tcp:103: 00010000:00010000:1.0:1789123054.587994:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123054.587999:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f342d80b200/0x7e1648d68fc91aa9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f415 expref: 9 pid: 5834 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.588030:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f342d80b200/0x7e1648d68fc91aa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f415 expref: 9 pid: 5834 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.588041:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f342d80b200/0x7e1648d68fc91aa9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f415 expref: 9 pid: 5834 timeout: 268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.588050:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789123054.588081:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19924a15-1c73-4644-a9ca-864666412d45+8:2354:x1876031364403456:12345-192.168.206.30@tcp:103: Request processed in 96us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123054.588088:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 13 00000100:00100000:0.0:1789123054.588963:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789123054.588992:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123054.589201:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123054.589216:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123054.589225:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123054.589236:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123054.589245:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381202560 00000100:00100000:0.0:1789123054.589250:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381202560 00000100:00100000:0.0:1789123054.589295:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381202688 00000100:00100000:0.0:1789123054.589299:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381202688 00000100:00100000:0.0:1789123054.589310:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381202816 00000100:00100000:0.0:1789123054.589313:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381202816 00000100:00100000:0.0:1789123054.589321:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381202944 00000100:00100000:0.0:1789123054.589323:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381202944 00000100:00100000:0.0:1789123054.589331:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381203072 00000100:00100000:0.0:1789123054.589334:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381203072 00000100:00100000:0.0:1789123054.589341:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381203200 00000100:00100000:0.0:1789123054.589344:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381203200 00000100:00100000:0.0:1789123054.589352:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381203328 00000100:00100000:0.0:1789123054.589354:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381203328 00000100:00100000:0.0:1789123054.589364:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789123054.589371:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+9:8446:x1876031381202560:12345-0@lo:104: 00010000:00010000:0.0:1789123054.589384:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91a94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91a9b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123054.589799:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789123054.589806:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+9:8446:x1876031381202560:12345-0@lo:104: Request processed in 435us (6415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123054.589813:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789123054.589831:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789123054.589838:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c330c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+8:8446:x1876031381202688:12345-0@lo:104: 00010000:00010000:0.0:1789123054.589846:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f343bd33e00/0x7e1648d68fc91a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91a71 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123054.589892:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1789123054.590131:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789123054.590138:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91a94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91a9b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.590146:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34029f2a00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:1.0:1789123054.590150:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91a94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc91a9b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.590160:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91a94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc91a9b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789123054.590167:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91a94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc91a9b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789123054.590172:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789123054.590211:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91a94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91a9b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.590218:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789123054.590246:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91a94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91a9b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.590254:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f34029f2a00/0x7e1648d68fc91a94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91a9b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.590267:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789123054.590270:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f343bd33e00/0x7e1648d68fc91a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91a71 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.590276:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33e00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:1.0:1789123054.590279:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f343bd33e00/0x7e1648d68fc91a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc91a71 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.590285:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f343bd33e00/0x7e1648d68fc91a6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc91a71 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789123054.590292:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f343bd33e00/0x7e1648d68fc91a6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc91a71 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789123054.590297:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789123054.590311:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f343bd33e00/0x7e1648d68fc91a6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91a71 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.590316:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789123054.590331:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f343bd33e00/0x7e1648d68fc91a6a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91a71 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.590338:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f343bd33e00/0x7e1648d68fc91a6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91a71 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.590347:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123054.590354:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123054.590356:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123054.590370:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd41f4a0-f4e3-41a1-856e-0c34af912023:3303:1876031381203456:0@lo:103: 00000100:00100000:1.0:1789123054.590405:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123054.590467:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381203584:0@lo:103: 00000100:00100000:1.0:1789123054.590491:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123054.590534:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381203456 00000100:00100000:1.0:1789123054.590538:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381203456 00010000:00010000:1.0:1789123054.590558:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f34029f2600/0x7e1648d68fc91a9b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91a94 expref: 19 pid: 5833 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123054.590576:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381203584 00000100:00100000:1.0:1789123054.590579:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381203584 00010000:00010000:1.0:1789123054.590588:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f343bd33200/0x7e1648d68fc91a71 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91a6a expref: 20 pid: 5834 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123054.590599:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789123054.590604:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd41f4a0-f4e3-41a1-856e-0c34af912023+20:3303:x1876031381203456:12345-0@lo:103: 00010000:00010000:1.0:1789123054.590613:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123054.590617:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f34029f2600/0x7e1648d68fc91a9b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91a94 expref: 20 pid: 5833 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.590647:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f34029f2600/0x7e1648d68fc91a9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc91a94 expref: 20 pid: 5833 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.590662:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789123054.590691:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd41f4a0-f4e3-41a1-856e-0c34af912023+20:3303:x1876031381203456:12345-0@lo:103: Request processed in 86us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123054.590697:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789123054.590711:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789123054.590724:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3304:x1876031381203584:12345-0@lo:103: 00010000:00010000:1.0:1789123054.590734:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123054.590738:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f343bd33200/0x7e1648d68fc91a71 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91a6a expref: 19 pid: 5834 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.590746:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f343bd33200/0x7e1648d68fc91a71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc91a6a expref: 19 pid: 5834 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123054.590755:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789123054.590782:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3304:x1876031381203584:12345-0@lo:103: Request processed in 59us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123054.590788:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789123054.590820:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381203584:0@lo:103: 00000100:00100000:1.0:1789123054.590843:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd41f4a0-f4e3-41a1-856e-0c34af912023:3303:1876031381203456:0@lo:103: 00000100:00100000:0.0:1789123054.590994:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c330c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+8:8446:x1876031381202688:12345-0@lo:104: Request processed in 61us (6370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123054.591012:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789123054.591056:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789123054.591063:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184ca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+7:8446:x1876031381202816:12345-0@lo:104: 00010000:00010000:0.0:1789123054.591072:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f34029f2200/0x7e1648d68fc91a4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91a55 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123054.591123:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789123054.591129:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184ca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+7:8446:x1876031381202816:12345-0@lo:104: Request processed in 67us (2137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123054.591135:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789123054.591148:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789123054.591155:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+6:8446:x1876031381202944:12345-0@lo:104: 00010000:00010000:0.0:1789123054.591162:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f34421d8c00/0x7e1648d68fc91a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91a47 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123054.591190:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789123054.591195:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+6:8446:x1876031381202944:12345-0@lo:104: Request processed in 41us (1994us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123054.591200:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789123054.591212:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789123054.591219:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+5:8446:x1876031381203072:12345-0@lo:104: 00010000:00010000:0.0:1789123054.591226:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f34421d9800/0x7e1648d68fc91a32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91a39 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123054.591252:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789123054.591257:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+5:8446:x1876031381203072:12345-0@lo:104: Request processed in 40us (2041us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123054.591263:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789123054.591283:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789123054.591289:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+4:8446:x1876031381203200:12345-0@lo:104: 00010000:00010000:0.0:1789123054.591297:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f34029f3600/0x7e1648d68fc91a08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91a0f expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123054.591326:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789123054.591331:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+4:8446:x1876031381203200:12345-0@lo:104: Request processed in 43us (2104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123054.591336:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789123054.591347:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789123054.591353:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:8446:x1876031381203328:12345-0@lo:104: 00010000:00010000:0.0:1789123054.591360:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f34421d8000/0x7e1648d68fc919de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc919e5 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123054.591387:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1789123054.591392:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:8446:x1876031381203328:12345-0@lo:104: Request processed in 40us (2156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123054.591398:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789123054.591696:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:2.0:1789123054.591712:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789123054.591718:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f34029f2200/0x7e1648d68fc91a4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91a55 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.591725:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34029f2200 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1789123054.591729:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f34029f2200/0x7e1648d68fc91a4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc91a55 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.591737:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f34029f2200/0x7e1648d68fc91a4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc91a55 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789123054.591744:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f34029f2200/0x7e1648d68fc91a4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc91a55 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123054.591749:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789123054.591772:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f34029f2200/0x7e1648d68fc91a4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91a55 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.591778:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789123054.591806:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f34029f2200/0x7e1648d68fc91a4e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91a55 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.591814:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f34029f2200/0x7e1648d68fc91a4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91a55 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.591828:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789123054.591831:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f34421d8c00/0x7e1648d68fc91a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91a47 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.591838:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34421d8c00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1789123054.591840:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f34421d8c00/0x7e1648d68fc91a40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc91a47 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.591847:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f34421d8c00/0x7e1648d68fc91a40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc91a47 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789123054.591853:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f34421d8c00/0x7e1648d68fc91a40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc91a47 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123054.591858:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789123054.591871:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f34421d8c00/0x7e1648d68fc91a40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91a47 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.591877:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789123054.591889:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f34421d8c00/0x7e1648d68fc91a40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91a47 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.591895:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f34421d8c00/0x7e1648d68fc91a40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91a47 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.591905:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789123054.591914:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f34421d9800/0x7e1648d68fc91a32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91a39 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.591920:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34421d9800 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1789123054.591922:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f34421d9800/0x7e1648d68fc91a32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc91a39 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.591929:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f34421d9800/0x7e1648d68fc91a32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc91a39 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789123054.591935:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f34421d9800/0x7e1648d68fc91a32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc91a39 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123054.591940:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789123054.591954:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f34421d9800/0x7e1648d68fc91a32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91a39 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.591960:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789123054.591965:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f34421d9800/0x7e1648d68fc91a32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91a39 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.591971:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f34421d9800/0x7e1648d68fc91a32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91a39 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.591980:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789123054.591983:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f34029f3600/0x7e1648d68fc91a08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91a0f expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.591989:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34029f3600 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1789123054.591992:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f34029f3600/0x7e1648d68fc91a08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc91a0f expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.592022:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f34029f3600/0x7e1648d68fc91a08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc91a0f expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789123054.592029:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f34029f3600/0x7e1648d68fc91a08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc91a0f expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123054.592034:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789123054.592047:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f34029f3600/0x7e1648d68fc91a08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91a0f expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.592053:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789123054.592058:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f34029f3600/0x7e1648d68fc91a08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91a0f expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.592065:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f34029f3600/0x7e1648d68fc91a08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91a0f expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.592075:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789123054.592078:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f34421d8000/0x7e1648d68fc919de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc919e5 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.592083:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34421d8000 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1789123054.592086:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f34421d8000/0x7e1648d68fc919de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc919e5 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.592092:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f34421d8000/0x7e1648d68fc919de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc919e5 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789123054.592097:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f34421d8000/0x7e1648d68fc919de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc919e5 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123054.592118:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789123054.592132:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f34421d8000/0x7e1648d68fc919de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc919e5 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.592138:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789123054.592142:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f34421d8000/0x7e1648d68fc919de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc919e5 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.592149:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f34421d8000/0x7e1648d68fc919de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc919e5 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.592162:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123054.592163:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123054.592165:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123054.592178:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34356712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381203840:0@lo:103: 00000100:00100000:2.0:1789123054.592215:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123054.592251:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789123054.592257:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435672940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381203968:0@lo:103: 00000100:00100000:2.0:1789123054.592278:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123054.592301:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435672580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381204096:0@lo:103: 00000100:00100000:2.0:1789123054.592326:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123054.592340:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789123054.592345:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34356730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381203712:0@lo:103: 00000100:00100000:2.0:1789123054.592380:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123054.592394:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381204224:0@lo:103: 00000100:00100000:2.0:1789123054.592416:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123054.592570:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381203840 00000100:00100000:2.0:1789123054.592582:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381203840 00010000:00010000:2.0:1789123054.592606:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f3401514c00/0x7e1648d68fc91a47 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91a40 expref: 19 pid: 5835 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123054.592623:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381203968 00000100:00100000:2.0:1789123054.592645:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381203968 00010000:00010000:2.0:1789123054.592657:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91a39 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91a32 expref: 20 pid: 5834 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123054.592668:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381204096 00000100:00100000:2.0:1789123054.592671:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381204096 00010000:00010000:2.0:1789123054.592681:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f3401514a00/0x7e1648d68fc91a0f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91a08 expref: 21 pid: 5833 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123054.592692:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381203712 00000100:00100000:2.0:1789123054.592694:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381203712 00010000:00010000:2.0:1789123054.592704:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f34421d9400/0x7e1648d68fc91a55 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91a4e expref: 22 pid: 5833 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123054.592714:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381204224 00000100:00100000:2.0:1789123054.592716:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381204224 00010000:00010000:2.0:1789123054.592726:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f3400030200/0x7e1648d68fc919e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc919de expref: 23 pid: 5835 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123054.592738:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789123054.592745:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435671a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd41f4a0-f4e3-41a1-856e-0c34af912023+23:3302:x1876031381203840:12345-0@lo:103: 00010000:00010000:2.0:1789123054.592756:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123054.592760:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f3401514c00/0x7e1648d68fc91a47 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91a40 expref: 23 pid: 5835 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.592769:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f3401514c00/0x7e1648d68fc91a47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc91a40 expref: 23 pid: 5835 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.592794:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123054.592826:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435671a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd41f4a0-f4e3-41a1-856e-0c34af912023+23:3302:x1876031381203840:12345-0@lo:103: Request processed in 80us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123054.592832:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789123054.592846:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789123054.592851:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435673c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd41f4a0-f4e3-41a1-856e-0c34af912023+22:3302:x1876031381203968:12345-0@lo:103: 00010000:00010000:2.0:1789123054.592858:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123054.592862:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91a39 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91a32 expref: 22 pid: 5834 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.592869:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91a39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc91a32 expref: 22 pid: 5834 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.592878:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123054.592899:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435673c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd41f4a0-f4e3-41a1-856e-0c34af912023+22:3302:x1876031381203968:12345-0@lo:103: Request processed in 48us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123054.592905:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789123054.592916:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789123054.592922:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3406286450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd41f4a0-f4e3-41a1-856e-0c34af912023+21:3304:x1876031381204096:12345-0@lo:103: 00010000:00010000:2.0:1789123054.592929:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123054.592933:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f3401514a00/0x7e1648d68fc91a0f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91a08 expref: 21 pid: 5833 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.592941:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f3401514a00/0x7e1648d68fc91a0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc91a08 expref: 21 pid: 5833 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.592950:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123054.592984:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3406286450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd41f4a0-f4e3-41a1-856e-0c34af912023+21:3304:x1876031381204096:12345-0@lo:103: Request processed in 62us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123054.592990:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789123054.593026:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789123054.593032:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd41f4a0-f4e3-41a1-856e-0c34af912023+20:3304:x1876031381203712:12345-0@lo:103: 00010000:00010000:2.0:1789123054.593038:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123054.593042:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f34421d9400/0x7e1648d68fc91a55 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91a4e expref: 20 pid: 5833 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.593051:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f34421d9400/0x7e1648d68fc91a55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc91a4e expref: 20 pid: 5833 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.593060:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123054.593081:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd41f4a0-f4e3-41a1-856e-0c34af912023+20:3304:x1876031381203712:12345-0@lo:103: Request processed in 50us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123054.593086:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789123054.593098:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789123054.593104:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3304:x1876031381204224:12345-0@lo:103: 00010000:00010000:2.0:1789123054.593122:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123054.593127:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f3400030200/0x7e1648d68fc919e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc919de expref: 19 pid: 5835 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.593135:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f3400030200/0x7e1648d68fc919e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc919de expref: 19 pid: 5835 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.593146:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f343bd32800/0x7e1648d68fc91ae8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.593155:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f343bd32800/0x7e1648d68fc91ae8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.593176:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f343bd32800/0x7e1648d68fc91ae8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.593184:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f343bd32800/0x7e1648d68fc91ae8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.593190:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f343bd32800/0x7e1648d68fc91ae8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.593197:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f343bd32800/0x7e1648d68fc91ae8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.593202:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32800 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:2.0:1789123054.593206:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f343bd32800/0x7e1648d68fc91ae8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.593214:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f343bd32800/0x7e1648d68fc91ae8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.593222:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f343bd32800/0x7e1648d68fc91ae8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123054.593232:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123054.593257:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3304:x1876031381204224:12345-0@lo:103: Request processed in 153us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123054.593263:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789123054.593295:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435672940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381203968:0@lo:103: 00000100:00100000:2.0:1789123054.593304:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34356712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381203840:0@lo:103: 00000100:00100000:2.0:1789123054.593334:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34356730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381203712:0@lo:103: 00000100:00100000:2.0:1789123054.593351:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381204224:0@lo:103: 00000100:00100000:2.0:1789123054.593358:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435672580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381204096:0@lo:103: 00010000:00010000:1.0:1789123054.593667:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123054.593845:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f34029f2600/0x7e1648d68fc91a9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc91a94 expref: 18 pid: 5833 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123054.593858:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a6580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876031381202560:0@lo:104: 00010000:00010000:3.0:1789123054.593884:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f343bd33200/0x7e1648d68fc91a71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc91a6a expref: 17 pid: 5834 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123054.593893:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876031381202688:0@lo:104: 00010000:00010000:3.0:1789123054.593902:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f34421d9400/0x7e1648d68fc91a55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc91a4e expref: 16 pid: 5833 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123054.593910:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a5a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876031381202816:0@lo:104: 00010000:00010000:3.0:1789123054.593920:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3401514c00/0x7e1648d68fc91a47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc91a40 expref: 15 pid: 5835 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123054.593928:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a4780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876031381202944:0@lo:104: 00010000:00010000:3.0:1789123054.593938:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91a39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc91a32 expref: 14 pid: 5834 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123054.593955:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876031381203072:0@lo:104: 00010000:00010000:3.0:1789123054.593968:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3401514a00/0x7e1648d68fc91a0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc91a08 expref: 13 pid: 5833 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123054.593975:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a7840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876031381203200:0@lo:104: 00010000:00010000:3.0:1789123054.593985:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3400030200/0x7e1648d68fc919e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc919de expref: 12 pid: 5835 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123054.593992:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a6d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876031381203328:0@lo:104: 00010000:00010000:3.0:1789123054.594083:0:8446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f343bd32800/0x7e1648d68fc91ae8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123054.594092:0:8446:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f343bd32800/0x7e1648d68fc91ae8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123054.594098:0:8446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f343bd32800/0x7e1648d68fc91ae8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123054.594104:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f343bd32800/0x7e1648d68fc91ae8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123055.003030:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123055.003069:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123055.003096:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123055.003199:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364403584 00000100:00100000:0.0:1789123055.003207:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364403584 00000100:00100000:0.0:1789123055.003273:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 26 00000100:00100000:0.0:1789123055.003283:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2352:x1876031364403584:12345-192.168.206.30@tcp:400: 00000100:00100000:0.0:1789123055.003366:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2352:x1876031364403584:12345-192.168.206.30@tcp:400: Request processed in 85us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123055.003373:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 26 00000100:00100000:3.0:1789123055.003996:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364403840 00000100:00100000:3.0:1789123055.004013:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364403840 00000100:00100000:3.0:1789123055.004055:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364403712 00000100:00100000:3.0:1789123055.004058:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364403712 00000100:00100000:3.0:1789123055.004076:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 11 00000100:00100000:3.0:1789123055.004083:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2352:x1876031364403840:12345-192.168.206.30@tcp:400: 00000100:00100000:3.0:1789123055.004139:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2352:x1876031364403840:12345-192.168.206.30@tcp:400: Request processed in 56us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123055.004158:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 11 00000100:00100000:3.0:1789123055.004173:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 12 00000100:00100000:3.0:1789123055.004180:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2352:x1876031364403712:12345-192.168.206.30@tcp:400: 00000100:00100000:3.0:1789123055.004216:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2352:x1876031364403712:12345-192.168.206.30@tcp:400: Request processed in 36us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123055.004221:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 12 00000100:00080000:2.0:1789123055.005010:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789123055.005015:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789123055.005018:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789123055.113026:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789123055.812704:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789123055.812711:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f3406274800 from 39 10000000:01000000:3.0:1789123055.812717:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789123055.812762:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc91aef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123055.812771:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc91aef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123055.812781:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc91aef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123055.812802:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d56940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381204352:0@lo:101: 00000100:00100000:3.0:1789123055.812866:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123055.812988:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408c6fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789123055.813295:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381204352 00000100:00100000:0.0:1789123055.813312:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381204352 00000100:00100000:0.0:1789123055.813491:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789123055.813501:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+12:5838:x1876031381204352:12345-0@lo:101: 00010000:00010000:0.0:1789123055.813514:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123055.813527:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3400030800/0x7e1648d68fc91af6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91aef expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123055.813550:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3400030800/0x7e1648d68fc91af6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91aef expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123055.813560:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3400030800/0x7e1648d68fc91af6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91aef expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123055.813569:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3400030800, rc 0) 00000100:00100000:0.0:1789123055.813620:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:5838:x1876031381204352:12345-0@lo:101: Request processed in 120us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123055.813649:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789123055.813733:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d56940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381204352:0@lo:101: 00010000:00010000:3.0:1789123055.813747:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc91aef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91af6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123055.813755:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc91aef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91af6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123055.813813:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d56940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381204480:0@lo:501: 00000100:00100000:3.0:1789123055.813839:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123055.814234:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408c6fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789123055.814410:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381204480 00000100:00100000:2.0:1789123055.814416:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381204480 00000100:00100000:2.0:1789123055.814443:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789123055.814450:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:5838:x1876031381204480:12345-0@lo:501: 00000100:00100000:2.0:1789123055.814821:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:5838:x1876031381204480:12345-0@lo:501: Request processed in 370us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123055.814829:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789123055.814883:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d56940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381204480:0@lo:501: 00000100:00100000:2.0:1789123055.814920:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343568c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381204608:0@lo:503: 00000100:00100000:2.0:1789123055.814960:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123055.814977:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340e066840 going to sleep for 11 seconds 00000100:00100000:2.0:1789123055.814991:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381204608 00000100:00100000:2.0:1789123055.814996:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381204608 00000100:00100000:2.0:1789123055.815015:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789123055.815022:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:5838:x1876031381204608:12345-0@lo:503: 00000100:00100000:2.0:1789123055.815290:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:5838:x1876031381204608:12345-0@lo:503: Request processed in 268us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123055.815297:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789123055.815531:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343568c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381204608:0@lo:503: 00000100:00100000:1.0:1789123055.815969:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8463:1876031381204736:0@lo:502: 00000100:00100000:1.0:1789123055.816015:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123055.816053:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f343c34fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789123055.816115:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381204736 00000100:00100000:2.0:1789123055.816120:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381204736 00000100:00100000:2.0:1789123055.816275:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789123055.816284:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:8463:x1876031381204736:12345-0@lo:502: 00000100:00100000:2.0:1789123055.816624:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:8463:x1876031381204736:12345-0@lo:502: Request processed in 341us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123055.816649:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789123055.816886:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8463:1876031381204736:0@lo:502: 00000100:00100000:1.0:1789123055.816930:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8463:1876031381204864:0@lo:502: 00000100:00100000:1.0:1789123055.816968:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123055.817036:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f343c34fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789123055.817067:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381204864 00000100:00100000:2.0:1789123055.817072:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381204864 00000100:00100000:2.0:1789123055.817137:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789123055.817261:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:8463:x1876031381204864:12345-0@lo:502: 00000100:00100000:2.0:1789123055.817603:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:8463:x1876031381204864:12345-0@lo:502: Request processed in 343us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123055.817610:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789123055.817837:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8463:1876031381204864:0@lo:502: 00000040:00080000:1.0:1789123055.817862:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789123055.818078:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789123055.818099:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789123055.818118:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc91aef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91af6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123055.818128:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc91aef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91af6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789123055.818137:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789123055.818140:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1789123055.818277:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789123055.818426:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401514c00/0x7e1648d68fc91afd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123055.818435:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f3401514c00/0x7e1648d68fc91afd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123055.818445:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f3401514c00/0x7e1648d68fc91afd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123055.818460:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381204992:0@lo:101: 00000100:00100000:3.0:1789123055.818497:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123055.818573:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408c6f300 going to sleep for 11 seconds 00000100:00100000:0.0:1789123055.818614:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381204992 00000100:00100000:0.0:1789123055.818620:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381204992 00000100:00100000:0.0:1789123055.818876:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789123055.818886:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+13:5838:x1876031381204992:12345-0@lo:101: 00010000:00010000:0.0:1789123055.818898:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123055.818910:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3400031800/0x7e1648d68fc91b04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91afd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123055.818930:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3400031800/0x7e1648d68fc91b04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91afd expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123055.818941:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3400031800/0x7e1648d68fc91b04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91afd expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123055.818963:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3400031800, rc 0) 00000100:00100000:0.0:1789123055.822648:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:5838:x1876031381204992:12345-0@lo:101: Request processed in 3742us (4128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123055.822661:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789123055.823073:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381204992:0@lo:101: 00010000:00010000:3.0:1789123055.823097:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f3401514c00/0x7e1648d68fc91afd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b04 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123055.823134:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f3401514c00/0x7e1648d68fc91afd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91b04 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123055.823443:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381205120:0@lo:501: 00000100:00100000:3.0:1789123055.823493:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123055.826436:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408c6f300 going to sleep for 11 seconds 00000100:00100000:1.0:1789123055.828336:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381205120 00000100:00100000:1.0:1789123055.828351:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381205120 00000100:00100000:1.0:1789123055.828404:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789123055.828414:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:5838:x1876031381205120:12345-0@lo:501: 00000100:00100000:1.0:1789123055.828869:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:5838:x1876031381205120:12345-0@lo:501: Request processed in 455us (5374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123055.828878:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789123055.828979:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381205120:0@lo:501: 00000100:00100000:3.0:1789123055.829023:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381205248:0@lo:503: 00000100:00100000:3.0:1789123055.829069:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123055.829115:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408c6f300 going to sleep for 11 seconds 00000100:00100000:0.0:1789123055.830813:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381205248 00000100:00100000:0.0:1789123055.830826:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381205248 00000100:00100000:0.0:1789123055.830879:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789123055.830889:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:5838:x1876031381205248:12345-0@lo:503: 00000100:00100000:0.0:1789123055.831250:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:5838:x1876031381205248:12345-0@lo:503: Request processed in 249us (2068us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123055.831260:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789123055.832903:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381205248:0@lo:503: 00000100:00100000:3.0:1789123055.833132:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8464:1876031381205376:0@lo:502: 00000100:00100000:3.0:1789123055.833260:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123055.833293:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408c6f480 going to sleep for 11 seconds 00000100:00100000:1.0:1789123055.833382:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381205376 00000100:00100000:1.0:1789123055.833388:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381205376 00000100:00100000:1.0:1789123055.833423:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789123055.833432:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:8464:x1876031381205376:12345-0@lo:502: 00000100:00100000:1.0:1789123055.833658:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:8464:x1876031381205376:12345-0@lo:502: Request processed in 227us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123055.833666:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789123055.834117:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8464:1876031381205376:0@lo:502: 00000020:01000000:3.0:1789123055.834152:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789123055.834162:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123055.834165:0:8464:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789123055.834171:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789123055.834291:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8464:1876031381205504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789123055.834334:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123055.834367:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408c6f480 going to sleep for 11 seconds 00000100:00100000:0.0:1789123055.836332:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381205504 00000100:00100000:0.0:1789123055.836345:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381205504 00000100:00100000:0.0:1789123055.836396:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789123055.836405:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:8464:x1876031381205504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789123055.836671:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:8464:x1876031381205504:12345-0@lo:502:llog_process_th.0 Request processed in 266us (2336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123055.836679:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789123055.837357:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8464:1876031381205504:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789123055.837394:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789123055.837408:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123055.837410:0:8464:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789123055.837416:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789123055.837900:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1789123055.837918:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789123055.837928:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401514c00/0x7e1648d68fc91afd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b04 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123055.837938:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f3401514c00/0x7e1648d68fc91afd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b04 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789123055.837958:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789123055.837960:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f343be04000 from 39 10000000:01000000:0.0:1789123055.837962:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789123055.837993:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3400031c00/0x7e1648d68fc91b0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123055.838000:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f3400031c00/0x7e1648d68fc91b0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123055.838008:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f3400031c00/0x7e1648d68fc91b0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123055.838027:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c983c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381205632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789123055.838070:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123055.838115:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3418274600 going to sleep for 11 seconds 00000100:00100000:2.0:1789123055.838173:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381205632 00000100:00100000:2.0:1789123055.838187:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381205632 00000100:00100000:2.0:1789123055.838227:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789123055.838236:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:5838:x1876031381205632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789123055.838246:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123055.838258:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f342d80b000/0x7e1648d68fc91b12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91b0b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123055.838278:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f342d80b000/0x7e1648d68fc91b12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91b0b expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123055.838287:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f342d80b000/0x7e1648d68fc91b12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91b0b expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123055.838295:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80b000, rc 0) 00000100:00100000:2.0:1789123055.838344:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:5838:x1876031381205632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123055.838352:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789123055.838480:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c983c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381205632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789123055.838492:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f3400031c00/0x7e1648d68fc91b0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b12 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123055.838501:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f3400031c00/0x7e1648d68fc91b0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91b12 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123055.838547:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381205760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789123055.838575:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123055.838596:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408c6f480 going to sleep for 11 seconds 00000100:00100000:0.0:1789123055.838652:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381205760 00000100:00100000:0.0:1789123055.838657:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381205760 00000100:00100000:0.0:1789123055.838683:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789123055.838690:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:5838:x1876031381205760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789123055.838923:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:5838:x1876031381205760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123055.838931:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789123055.839023:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381205760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789123055.839052:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381205888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789123055.839088:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123055.839118:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408c6f480 going to sleep for 11 seconds 00000100:00100000:3.0:1789123055.839131:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381205888 00000100:00100000:3.0:1789123055.839134:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381205888 00000100:00100000:3.0:1789123055.839153:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789123055.839159:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:5838:x1876031381205888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789123055.839301:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:5838:x1876031381205888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123055.839308:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789123055.839344:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381205888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789123055.839501:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8465:1876031381206016:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789123055.839540:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123055.839560:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381206016 00000100:00100000:3.0:1789123055.839564:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381206016 00000100:00100000:3.0:1789123055.839581:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789123055.839587:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:8465:x1876031381206016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789123055.839755:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:8465:x1876031381206016:12345-0@lo:502:llog_process_th.0 Request processed in 167us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123055.839762:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789123055.839789:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408c6fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789123055.839802:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8465:1876031381206016:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789123055.839838:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8465:1876031381206144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789123055.839871:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123055.839890:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381206144 00000100:00100000:3.0:1789123055.839894:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381206144 00000100:00100000:3.0:1789123055.839910:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789123055.839915:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:8465:x1876031381206144:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789123055.840030:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:8465:x1876031381206144:12345-0@lo:502:llog_process_th.0 Request processed in 114us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123055.840037:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789123055.840063:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34033566c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789123055.840076:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8465:1876031381206144:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789123055.840095:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789123055.840150:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789123055.840164:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789123055.840173:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3400031c00/0x7e1648d68fc91b0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b12 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123055.840188:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f3400031c00/0x7e1648d68fc91b0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b12 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789123055.840196:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789123055.840198:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1789123055.840201:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789123055.840220:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401515600/0x7e1648d68fc91b19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123055.840228:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f3401515600/0x7e1648d68fc91b19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123055.840237:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f3401515600/0x7e1648d68fc91b19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123055.840250:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381206272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789123055.840276:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123055.840290:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34033566c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789123055.840302:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381206272 00000100:00100000:3.0:1789123055.840305:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381206272 00000100:00100000:3.0:1789123055.840322:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789123055.840328:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:5838:x1876031381206272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789123055.840335:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123055.840345:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3401515200/0x7e1648d68fc91b20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91b19 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123055.840364:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3401515200/0x7e1648d68fc91b20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91b19 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123055.840385:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3401515200/0x7e1648d68fc91b20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91b19 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123055.840393:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3401515200, rc 0) 00000100:00100000:3.0:1789123055.840423:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:5838:x1876031381206272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123055.840430:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789123055.840458:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381206272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789123055.840470:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f3401515600/0x7e1648d68fc91b19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b20 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123055.840487:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f3401515600/0x7e1648d68fc91b19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91b20 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123055.840527:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381206400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789123055.840552:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123055.840566:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34033566c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789123055.840577:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381206400 00000100:00100000:3.0:1789123055.840580:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381206400 00000100:00100000:3.0:1789123055.840597:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789123055.840603:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:5838:x1876031381206400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789123055.840815:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:5838:x1876031381206400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 211us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123055.840821:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789123055.840848:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381206400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789123055.840885:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381206528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789123055.840920:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123055.840934:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340555a480 going to sleep for 11 seconds 00000100:00100000:3.0:1789123055.840945:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381206528 00000100:00100000:3.0:1789123055.840948:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381206528 00000100:00100000:3.0:1789123055.840965:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789123055.840970:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:5838:x1876031381206528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789123055.841094:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:5838:x1876031381206528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123055.841115:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789123055.841150:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381206528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789123055.841376:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8466:1876031381206656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789123055.841408:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123055.841426:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381206656 00000100:00100000:3.0:1789123055.841430:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381206656 00000100:00100000:3.0:1789123055.841447:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789123055.841453:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:8466:x1876031381206656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789123055.841576:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:8466:x1876031381206656:12345-0@lo:502:llog_process_th.0 Request processed in 122us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123055.841583:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789123055.841610:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340555a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789123055.841623:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8466:1876031381206656:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789123055.841663:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789123055.841670:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123055.841677:0:8466:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789123055.841683:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789123055.841702:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8466:1876031381206784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789123055.841734:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123055.841753:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381206784 00000100:00100000:3.0:1789123055.841757:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381206784 00000100:00100000:3.0:1789123055.841773:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789123055.841777:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:8466:x1876031381206784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789123055.842382:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34033566c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789123055.846449:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:8466:x1876031381206784:12345-0@lo:502:llog_process_th.0 Request processed in 4662us (4706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123055.846461:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789123055.846579:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8466:1876031381206784:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789123055.846615:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789123055.846622:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789123055.846659:0:8466:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789123055.846665:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1789123055.847895:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1789123055.847919:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789123055.847930:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401515600/0x7e1648d68fc91b19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b20 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123055.847942:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f3401515600/0x7e1648d68fc91b19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b20 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789123055.847952:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789123055.847955:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f3408401800 from 39 10000000:01000000:3.0:1789123055.847958:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789123055.847990:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401515e00/0x7e1648d68fc91b27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123055.847998:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f3401515e00/0x7e1648d68fc91b27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123055.848007:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f3401515e00/0x7e1648d68fc91b27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123055.848043:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381206912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789123055.848092:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123055.848135:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340555a600 going to sleep for 11 seconds 00000100:00100000:0.0:1789123055.848270:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381206912 00000100:00100000:0.0:1789123055.848277:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381206912 00000100:00100000:0.0:1789123055.848323:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789123055.848332:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:5838:x1876031381206912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789123055.848345:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123055.848363:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3400030200/0x7e1648d68fc91b2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91b27 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123055.848385:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3400030200/0x7e1648d68fc91b2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91b27 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123055.848395:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3400030200/0x7e1648d68fc91b2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91b27 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123055.848404:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3400030200, rc 0) 00000100:00100000:0.0:1789123055.848436:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381206912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123055.848442:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789123055.848540:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381206912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789123055.848554:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f3401515e00/0x7e1648d68fc91b27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b2e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123055.848563:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f3401515e00/0x7e1648d68fc91b27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91b2e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123055.848609:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381207040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789123055.848809:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123055.848879:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340555a600 going to sleep for 11 seconds 00000100:00100000:0.0:1789123055.853963:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381207040 00000100:00100000:0.0:1789123055.853976:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381207040 00000100:00100000:0.0:1789123055.854040:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789123055.854051:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381207040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789123055.854594:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381207040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 544us (5784us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123055.854603:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789123055.861853:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381207040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789123055.861918:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381207168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789123055.862001:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123055.862088:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340555a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789123055.865503:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381207168 00000100:00100000:2.0:1789123055.865518:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381207168 00000100:00100000:2.0:1789123055.865580:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789123055.865590:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381207168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789123055.865846:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381207168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 256us (3844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123055.865853:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789123055.866079:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381207168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789123055.866572:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8467:1876031381207296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789123055.866658:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123055.866693:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408c6f480 going to sleep for 11 seconds 00000100:00100000:0.0:1789123055.866764:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381207296 00000100:00100000:0.0:1789123055.866770:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381207296 00000100:00100000:0.0:1789123055.866808:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789123055.866817:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:8467:x1876031381207296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789123055.867009:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:8467:x1876031381207296:12345-0@lo:502:llog_process_th.0 Request processed in 193us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123055.867016:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789123055.867088:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8467:1876031381207296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789123055.867135:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8467:1876031381207424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789123055.867176:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123055.867209:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340555a600 going to sleep for 11 seconds 00000100:00100000:1.0:1789123055.867307:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381207424 00000100:00100000:1.0:1789123055.867312:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381207424 00000100:00100000:1.0:1789123055.867344:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789123055.867351:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:8467:x1876031381207424:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789123055.867500:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:8467:x1876031381207424:12345-0@lo:502:llog_process_th.0 Request processed in 149us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123055.867507:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789123055.867999:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8467:1876031381207424:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789123055.868025:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789123055.868287:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789123055.868312:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789123055.868321:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401515e00/0x7e1648d68fc91b27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b2e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123055.868331:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f3401515e00/0x7e1648d68fc91b27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b2e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789123055.868341:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789123055.868344:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1789123055.868347:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789123055.868377:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3400030c00/0x7e1648d68fc91b35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123055.868385:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f3400030c00/0x7e1648d68fc91b35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123055.868394:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f3400030c00/0x7e1648d68fc91b35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123055.868411:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c983c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381207552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789123055.868449:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123055.868483:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3418274540 going to sleep for 11 seconds 00000100:00100000:1.0:1789123055.868531:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381207552 00000100:00100000:1.0:1789123055.868536:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381207552 00000100:00100000:1.0:1789123055.868572:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789123055.868579:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381207552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789123055.868590:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123055.868601:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f343bd33e00/0x7e1648d68fc91b3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91b35 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123055.868679:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f343bd33e00/0x7e1648d68fc91b3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91b35 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123055.868691:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f343bd33e00/0x7e1648d68fc91b3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91b35 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123055.868700:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd33e00, rc 0) 00000100:00100000:1.0:1789123055.868734:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381207552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123055.868740:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789123055.868892:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c983c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381207552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789123055.868907:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f3400030c00/0x7e1648d68fc91b35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b3c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123055.868917:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f3400030c00/0x7e1648d68fc91b35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91b3c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123055.868965:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c983c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381207680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789123055.869001:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123055.869033:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3418274540 going to sleep for 11 seconds 00000100:00100000:3.0:1789123055.869077:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381207680 00000100:00100000:3.0:1789123055.869082:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381207680 00000100:00100000:3.0:1789123055.869125:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789123055.869133:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381207680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789123055.869539:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381207680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 407us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123055.869548:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789123055.869609:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c983c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381207680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789123055.869764:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c983c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381207808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789123055.869805:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123055.869833:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3418274540 going to sleep for 11 seconds 00000100:00100000:1.0:1789123055.869874:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381207808 00000100:00100000:1.0:1789123055.869879:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381207808 00000100:00100000:1.0:1789123055.869913:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789123055.869920:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381207808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789123055.870064:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381207808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123055.870071:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789123055.870384:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c983c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381207808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789123055.870812:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c983c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8468:1876031381207936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789123055.870860:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123055.870890:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3418274a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789123055.870980:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381207936 00000100:00100000:1.0:1789123055.870985:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381207936 00000100:00100000:1.0:1789123055.871021:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789123055.871028:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:8468:x1876031381207936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789123055.871365:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:8468:x1876031381207936:12345-0@lo:502:llog_process_th.0 Request processed in 337us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123055.871373:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789123055.871497:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c983c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8468:1876031381207936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789123055.871525:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789123055.871534:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789123055.871537:0:8468:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789123055.871543:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789123055.871564:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c983c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8468:1876031381208064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789123055.871599:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123055.871797:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3418274a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789123055.871986:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381208064 00000100:00100000:3.0:1789123055.871991:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381208064 00000100:00100000:3.0:1789123055.872066:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789123055.872076:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:8468:x1876031381208064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789123055.872354:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:8468:x1876031381208064:12345-0@lo:502:llog_process_th.0 Request processed in 279us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123055.872361:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789123055.872445:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c983c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8468:1876031381208064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789123055.872469:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789123055.872474:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789123055.872476:0:8468:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789123055.872480:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1789123055.872936:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1789123055.872956:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789123055.872965:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3400030c00/0x7e1648d68fc91b35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b3c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123055.872974:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f3400030c00/0x7e1648d68fc91b35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b3c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789123055.872983:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789123055.872993:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f3407c54ed8 from 1 10000000:01000000:3.0:1789123055.872996:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789123055.873022:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401514600/0x7e1648d68fc91b43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123055.873029:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f3401514600/0x7e1648d68fc91b43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123055.873038:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f3401514600/0x7e1648d68fc91b43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123055.873056:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381208192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789123055.873094:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123055.873144:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3427b08240 going to sleep for 11 seconds 00000100:00100000:0.0:1789123055.873265:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381208192 00000100:00100000:0.0:1789123055.873270:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381208192 00000100:00100000:0.0:1789123055.873313:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789123055.873321:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381208192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789123055.873331:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123055.873343:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3400031000/0x7e1648d68fc91b4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91b43 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123055.873364:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3400031000/0x7e1648d68fc91b4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91b43 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123055.873375:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3400031000/0x7e1648d68fc91b4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91b43 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123055.873384:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3400031000, rc 0) 00000100:00100000:0.0:1789123055.873426:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:5838:x1876031381208192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123055.873433:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789123055.873564:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381208192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789123055.873577:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f3401514600/0x7e1648d68fc91b43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b4a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123055.873586:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f3401514600/0x7e1648d68fc91b43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91b4a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123055.873772:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381208320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789123055.873798:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123055.873858:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3427b08240 going to sleep for 11 seconds 00000100:00100000:2.0:1789123055.873952:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381208320 00000100:00100000:2.0:1789123055.873957:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381208320 00000100:00100000:2.0:1789123055.874016:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789123055.874024:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:5838:x1876031381208320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789123055.874260:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:5838:x1876031381208320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (459us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789123055.874267:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789123055.874392:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381208320:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789123055.874419:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789123055.874426:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401514600/0x7e1648d68fc91b43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b4a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123055.874434:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f3401514600/0x7e1648d68fc91b43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b4a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123056.134029:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123057.157705:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123057.669281:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343568fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381208448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789123057.669350:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123057.669512:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381208448 00000100:00100000:2.0:1789123057.669519:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381208448 00000100:00100000:2.0:1789123057.669588:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789123057.669596:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409c983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381208448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789123057.669658:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123057.669705:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409c983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381208448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123057.669712:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1789123057.669745:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f343568fc00 x1876031381208448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123073 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123057.669760:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343568fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381208448:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789123057.669889:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789123057.670074:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876031381208704:0@lo:400:kworker.0 00000100:00100000:0.0:1789123057.670134:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123057.670152:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789123057.670157:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381208832:0@lo:400:kworker.0 00000100:00100000:0.0:1789123057.670173:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123057.670318:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd41f4a0-f4e3-41a1-856e-0c34af912023:3303:1876031381208576:0@lo:400:kworker.0 00000100:00100000:1.0:1789123057.670349:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123057.670380:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f341848a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876031381209088:0@lo:400:kworker.0 00000100:00100000:1.0:1789123057.670398:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123057.670422:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789123057.670427:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381208960:0@lo:400:kworker.0 00000100:00100000:1.0:1789123057.670447:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123057.670504:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381208704 00000100:00100000:3.0:1789123057.670508:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381208704 00000100:00100000:3.0:1789123057.670539:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381208832 00000100:00100000:3.0:1789123057.670541:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381208832 00000100:00100000:3.0:1789123057.670565:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381209088 00000100:00100000:3.0:1789123057.670572:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381209088 00000100:00100000:3.0:1789123057.670588:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789123057.670594:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876031381208704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123057.670648:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876031381208704:12345-0@lo:400:kworker.0 Request processed in 34us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123057.670654:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789123057.670666:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789123057.670671:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381208832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123057.670694:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381208832:12345-0@lo:400:kworker.0 Request processed in 23us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123057.670699:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789123057.670707:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789123057.670712:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876031381209088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123057.670735:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876031381209088:12345-0@lo:400:kworker.0 Request processed in 23us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123057.670741:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789123057.670754:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381208960 00000100:00100000:3.0:1789123057.670757:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381208960 00000100:00100000:3.0:1789123057.670776:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789123057.670781:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381208960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123057.670805:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381208960:12345-0@lo:400:kworker.0 Request processed in 24us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123057.670810:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1789123057.670820:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789123057.670824:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789123057.670838:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3409d56940 x1876031381208960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123057.670859:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381208960:0@lo:400:kworker.0 00000100:00100000:3.0:1789123057.670869:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f341848a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876031381209088:0@lo:400:kworker.0 00000100:00100000:0.0:1789123057.671016:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381208832:0@lo:400:kworker.0 00000100:00100000:0.0:1789123057.671025:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876031381208704:0@lo:400:kworker.0 00000100:00100000:0.0:1789123057.671044:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381208576 00000100:00100000:0.0:1789123057.671046:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381208576 00000100:00100000:0.0:1789123057.671074:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789123057.671080:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3303:x1876031381208576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123057.671128:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3303:x1876031381208576:12345-0@lo:400:kworker.0 Request processed in 47us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123057.671133:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789123057.671222:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd41f4a0-f4e3-41a1-856e-0c34af912023:3303:1876031381208576:0@lo:400:kworker.0 00000100:00100000:2.0:1789123057.952015:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123057.952085:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364403968 00000100:00100000:3.0:1789123057.952104:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364403968 00000100:00100000:3.0:1789123057.952158:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 164 00000100:00100000:3.0:1789123057.952167:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+8:5592:x1876031364403968:12345-192.168.206.30@tcp:101: 00010000:00010000:3.0:1789123057.952189:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123057.952213:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3401515a00/0x7e1648d68fc91b51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f47e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123057.952240:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3401515a00/0x7e1648d68fc91b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f47e expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123057.952250:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3401515a00/0x7e1648d68fc91b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f47e expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123057.952259:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3401515a00, rc 0) 00000100:00100000:3.0:1789123057.952316:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+9:5592:x1876031364403968:12345-192.168.206.30@tcp:101: Request processed in 149us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123057.952324:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 164 00000100:00100000:3.0:1789123057.954831:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123057.957328:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364404096 00000100:00100000:1.0:1789123057.957342:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364404096 00000100:00100000:1.0:1789123057.957513:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 165 00000100:00100000:1.0:1789123057.957525:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+9:5592:x1876031364404096:12345-192.168.206.30@tcp:501: 00000100:00100000:1.0:1789123057.957830:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+9:5592:x1876031364404096:12345-192.168.206.30@tcp:501: Request processed in 306us (3007us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123057.957839:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 165 00000100:00100000:0.0:1789123057.960248:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123057.960440:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364404224 00000100:00100000:2.0:1789123057.960449:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364404224 00000100:00100000:2.0:1789123057.960499:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 166 00000100:00100000:2.0:1789123057.960507:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+9:5592:x1876031364404224:12345-192.168.206.30@tcp:503: 00000100:00100000:2.0:1789123057.960738:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+9:5592:x1876031364404224:12345-192.168.206.30@tcp:503: Request processed in 231us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123057.960746:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 166 00000100:00100000:3.0:1789123057.974111:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123057.974499:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364404352 00000100:00100000:1.0:1789123057.974510:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364404352 00000100:00100000:1.0:1789123057.974582:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 167 00000100:00100000:1.0:1789123057.974593:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+9:6077:x1876031364404352:12345-192.168.206.30@tcp:502: 00000100:00100000:1.0:1789123057.975035:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+9:6077:x1876031364404352:12345-192.168.206.30@tcp:502: Request processed in 443us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123057.975043:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 167 00000100:00100000:0.0:1789123057.980588:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123057.980836:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364404480 00000100:00100000:1.0:1789123057.980847:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364404480 00000100:00100000:1.0:1789123057.980901:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 168 00000100:00100000:1.0:1789123057.980911:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+9:6077:x1876031364404480:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789123057.981172:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+9:6077:x1876031364404480:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 262us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123057.981186:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 168 00000100:00100000:0.0:1789123057.988729:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123057.988944:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364404608 00000100:00100000:3.0:1789123057.988955:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364404608 00000100:00100000:3.0:1789123057.989101:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 169 00000100:00100000:3.0:1789123057.989160:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+9:5592:x1876031364404608:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789123057.989177:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123057.989266:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3401515000/0x7e1648d68fc91b58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f485 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123057.989295:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3401515000/0x7e1648d68fc91b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f485 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123057.989306:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3401515000/0x7e1648d68fc91b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f485 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123057.989315:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3401515000, rc 0) 00000100:00100000:3.0:1789123057.989417:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+10:5592:x1876031364404608:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 Request processed in 260us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123057.989424:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 169 00000100:00100000:3.0:1789123057.996107:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123057.996774:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364404736 00000100:00100000:2.0:1789123057.996787:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364404736 00000100:00100000:2.0:1789123057.996846:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 170 00000100:00100000:2.0:1789123057.996857:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+10:5592:x1876031364404736:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789123057.997150:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+10:5592:x1876031364404736:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 Request processed in 294us (1061us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789123057.997159:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 170 00010000:00010000:1.0:1789123058.184970:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123059.204824:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123059.205376:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789123059.205400:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f341848a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381209216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789123059.205478:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123059.205549:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381209216 00000100:00100000:3.0:1789123059.205557:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381209216 00000100:00080000:2.0:1789123059.205589:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789123059.205617:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789123059.205661:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3418488f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381209216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789123059.206930:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789123059.207023:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3418488f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381209216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1396us (1543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123059.207033:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789123059.210657:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f341848a1c0 x1876031381209216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123075 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123059.212249:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f341848a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381209216:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1789123059.839306:0:8506:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1ca79ca0 20000000:00000080:3.0:1789123059.839323:0:8506:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f3406250800 uarg=0000000000000000 20000000:01000000:3.0:1789123059.839356:0:8506:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789123059.839362:0:8506:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789123059.839367:0:8506:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789123059.841066:0:8507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1789123059.841298:0:8506:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789123059.849873:0:8506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789123059.849935:0:8506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789123059.850007:0:8506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789123059.850025:0:8506:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789123059.850043:0:8506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f343bd33200/0x7e1648d68fc91b5f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123059.850062:0:8506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f34421d9600/0x7e1648d68fc918db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc918d4 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123059.850088:0:8506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f34029f3200/0x7e1648d68fc91936 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc9192f expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123059.850096:0:8506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f34421d9c00/0x7e1648d68fc91a01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc919fa expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123059.850107:0:8506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f343bd32400/0x7e1648d68fc91abe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f44d expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123059.850114:0:8506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f343bd33200/0x7e1648d68fc91b5f lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123059.850173:0:8506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f343bd32400/0x7e1648d68fc91abe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f44d expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123059.850189:0:8506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f343bd32400/0x7e1648d68fc91abe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f44d expref: 9 pid: 5833 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123059.850220:0:8506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1876031381209344:192.168.206.30@tcp:104: 00010000:00010000:1.0:1789123059.850320:0:8506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f34421d9c00/0x7e1648d68fc91a01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc919fa expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123059.850330:0:8506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f34421d9c00/0x7e1648d68fc91a01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc919fa expref: 18 pid: 5835 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123059.850340:0:8506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a6d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1876031381209472:0@lo:104: 00000100:00100000:1.0:1789123059.850374:0:8506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789123059.850489:0:8506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f34029f3200/0x7e1648d68fc91936 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc9192f expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123059.850498:0:8506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f34029f3200/0x7e1648d68fc91936 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc9192f expref: 18 pid: 5834 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123059.850506:0:8506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1876031381209600:0@lo:104: 00000100:00100000:1.0:1789123059.850528:0:8506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789123059.850544:0:8506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f34421d9600/0x7e1648d68fc918db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc918d4 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123059.850552:0:8506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f34421d9600/0x7e1648d68fc918db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc918d4 expref: 18 pid: 5835 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123059.850560:0:8506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a4780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1876031381209728:0@lo:104: 00000100:00100000:1.0:1789123059.850574:0:8506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34181ee780 going to sleep for 11 seconds 00000100:00100000:2.0:1789123059.850961:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789123059.850988:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123059.850999:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381209472 00000100:00100000:2.0:1789123059.851005:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381209472 00000100:00100000:2.0:1789123059.851309:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381209600 00000100:00100000:2.0:1789123059.851313:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381209600 00000100:00100000:2.0:1789123059.851325:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381209728 00000100:00100000:2.0:1789123059.851327:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381209728 00000100:00100000:2.0:1789123059.851338:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789123059.851345:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+5:8506:x1876031381209472:12345-0@lo:104: 00010000:00010000:2.0:1789123059.851357:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f34029f2000/0x7e1648d68fc919fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91a01 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123059.851482:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789123059.851489:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+5:8506:x1876031381209472:12345-0@lo:104: Request processed in 144us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123059.851495:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789123059.851510:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789123059.851515:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+4:8506:x1876031381209600:12345-0@lo:104: 00010000:00010000:2.0:1789123059.851523:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f3400031400/0x7e1648d68fc9192f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91936 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123059.851553:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789123059.851558:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+4:8506:x1876031381209600:12345-0@lo:104: Request processed in 43us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123059.851564:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789123059.851589:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789123059.851594:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:8506:x1876031381209728:12345-0@lo:104: 00010000:00010000:2.0:1789123059.851601:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f3401514000/0x7e1648d68fc918d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc918db expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123059.851652:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789123059.851657:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:8506:x1876031381209728:12345-0@lo:104: Request processed in 63us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123059.851663:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789123059.851680:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789123059.851685:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f34029f2000/0x7e1648d68fc919fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91a01 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123059.851693:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34029f2000 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1789123059.851697:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f34029f2000/0x7e1648d68fc919fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc91a01 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123059.851705:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f34029f2000/0x7e1648d68fc919fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc91a01 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789123059.851712:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f34029f2000/0x7e1648d68fc919fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc91a01 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123059.851718:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789123059.851743:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f34029f2000/0x7e1648d68fc919fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91a01 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123059.851749:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789123059.851768:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f34029f2000/0x7e1648d68fc919fa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91a01 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123059.851786:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f34029f2000/0x7e1648d68fc919fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91a01 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123059.851809:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789123059.851813:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f3400031400/0x7e1648d68fc9192f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91936 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123059.851819:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3400031400 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1789123059.851822:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f3400031400/0x7e1648d68fc9192f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc91936 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123059.851829:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f3400031400/0x7e1648d68fc9192f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc91936 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789123059.851834:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f3400031400/0x7e1648d68fc9192f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc91936 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123059.851839:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789123059.851852:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f3400031400/0x7e1648d68fc9192f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91936 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123059.851857:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789123059.851872:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f3400031400/0x7e1648d68fc9192f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91936 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123059.851879:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f3400031400/0x7e1648d68fc9192f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91936 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123059.851890:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789123059.851893:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f3401514000/0x7e1648d68fc918d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc918db expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123059.851907:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401514000 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1789123059.851910:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f3401514000/0x7e1648d68fc918d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc918db expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123059.851916:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f3401514000/0x7e1648d68fc918d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc918db expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789123059.851922:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f3401514000/0x7e1648d68fc918d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc918db expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123059.851927:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789123059.851939:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f3401514000/0x7e1648d68fc918d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc918db expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123059.851945:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789123059.851951:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f3401514000/0x7e1648d68fc918d4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc918db expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123059.851957:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f3401514000/0x7e1648d68fc918d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc918db expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123059.851969:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123059.851971:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123059.851972:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123059.851985:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343568f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381209856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789123059.852017:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123059.852061:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343568ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381209984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789123059.852095:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123059.852122:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789123059.853091:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381209856 00000100:00100000:0.0:1789123059.853100:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381209856 00010000:00010000:0.0:1789123059.853128:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f34421d9c00/0x7e1648d68fc91a01 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc919fa expref: 19 pid: 5835 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123059.853154:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381209984 00000100:00100000:0.0:1789123059.853156:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381209984 00010000:00010000:0.0:1789123059.853166:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f34029f3200/0x7e1648d68fc91936 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc9192f expref: 20 pid: 5834 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123059.853178:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789123059.853186:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd41f4a0-f4e3-41a1-856e-0c34af912023+20:3305:x1876031381209856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789123059.853208:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123059.853213:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f34421d9c00/0x7e1648d68fc91a01 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc919fa expref: 20 pid: 5835 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123059.853223:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f34421d9c00/0x7e1648d68fc91a01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc919fa expref: 20 pid: 5835 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123059.853897:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123059.853961:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd41f4a0-f4e3-41a1-856e-0c34af912023+20:3305:x1876031381209856:12345-0@lo:103:ldlm_bl.0 Request processed in 774us (1942us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123059.853970:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789123059.854000:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789123059.854009:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3302:x1876031381209984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789123059.854019:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123059.854024:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f34029f3200/0x7e1648d68fc91936 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc9192f expref: 19 pid: 5834 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123059.854034:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f34029f3200/0x7e1648d68fc91936 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc9192f expref: 19 pid: 5834 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123059.854051:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123059.854074:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3302:x1876031381209984:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (1977us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123059.854089:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:3.0:1789123059.854323:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123059.854803:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f34421d9c00/0x7e1648d68fc91a01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc919fa expref: 18 pid: 5835 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123059.854830:0:8506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a6d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1876031381209472:0@lo:104: 00010000:00010000:1.0:1789123059.854845:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f34029f3200/0x7e1648d68fc91936 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc9192f expref: 17 pid: 5834 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123059.854854:0:8506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1876031381209600:0@lo:104: 00000100:00100000:1.0:1789123059.854862:0:8506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a4780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1876031381209728:0@lo:104: 00000100:00100000:2.0:1789123059.855811:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343568e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381210112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789123059.855857:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123059.855903:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343568ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381209984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789123059.855934:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343568f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381209856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789123059.856023:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123059.856045:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381210112 00000100:00100000:0.0:1789123059.856051:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381210112 00010000:00010000:0.0:1789123059.856095:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f34421d9600/0x7e1648d68fc918db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc918d4 expref: 17 pid: 5835 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123059.856132:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364404864 00000100:00100000:0.0:1789123059.856135:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364404864 00010000:00010000:0.0:1789123059.856147:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f343bd32400/0x7e1648d68fc91abe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f44d expref: 10 pid: 5833 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123059.856159:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789123059.856165:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:3302:x1876031381210112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789123059.856175:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123059.856180:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f34421d9600/0x7e1648d68fc918db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc918d4 expref: 17 pid: 5835 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123059.856189:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f34421d9600/0x7e1648d68fc918db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc918d4 expref: 17 pid: 5835 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123059.856203:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f34421d9600/0x7e1648d68fc918db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc918d4 expref: 17 pid: 5835 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123059.856215:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123059.856251:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:3302:x1876031381210112:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123059.856258:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789123059.856272:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 24 00000100:00100000:0.0:1789123059.856278:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19924a15-1c73-4644-a9ca-864666412d45+10:2354:x1876031364404864:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789123059.856285:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123059.856290:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f343bd32400/0x7e1648d68fc91abe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f44d expref: 10 pid: 5833 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123059.856309:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f343bd32400/0x7e1648d68fc91abe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f44d expref: 10 pid: 5833 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123059.856321:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f343bd33200/0x7e1648d68fc91b5f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123059.856330:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f343bd33200/0x7e1648d68fc91b5f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123059.856343:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f343bd33200/0x7e1648d68fc91b5f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123059.856350:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f343bd33200/0x7e1648d68fc91b5f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123059.856357:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f343bd33200/0x7e1648d68fc91b5f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123059.856364:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f343bd33200/0x7e1648d68fc91b5f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123059.856370:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33200 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:0.0:1789123059.856374:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f343bd33200/0x7e1648d68fc91b5f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123059.856382:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f343bd33200/0x7e1648d68fc91b5f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123059.856390:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f343bd33200/0x7e1648d68fc91b5f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123059.856418:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123059.856452:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19924a15-1c73-4644-a9ca-864666412d45+10:2354:x1876031364404864:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 174us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123059.856459:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 24 00000100:00100000:2.0:1789123059.856549:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343568e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381210112:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789123059.856645:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f343bd32400/0x7e1648d68fc91abe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f44d expref: 9 pid: 5833 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123059.856655:0:8506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1876031381209344:192.168.206.30@tcp:104: 00010000:00010000:1.0:1789123059.856675:0:8506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f343bd33200/0x7e1648d68fc91b5f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123059.856683:0:8506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f343bd33200/0x7e1648d68fc91b5f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123059.856689:0:8506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f343bd33200/0x7e1648d68fc91b5f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123059.856695:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f343bd33200/0x7e1648d68fc91b5f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123060.131310:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123060.131356:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123060.131389:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123060.131472:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364404992 00000100:00100000:3.0:1789123060.131482:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364404992 00000100:00100000:2.0:1789123060.131515:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364405120 00000100:00100000:2.0:1789123060.131519:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364405120 00000100:00100000:2.0:1789123060.131546:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364405248 00000100:00100000:3.0:1789123060.131551:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 30 00000100:00100000:2.0:1789123060.131559:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364405248 00000100:00100000:3.0:1789123060.131560:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2352:x1876031364404992:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1789123060.131575:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 14 00000100:00100000:2.0:1789123060.131581:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2352:x1876031364405120:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1789123060.131654:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2352:x1876031364405120:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 45us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123060.131656:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789123060.131661:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 14 00000100:00100000:1.0:1789123060.131664:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789123060.131677:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 15 00000100:00100000:2.0:1789123060.131683:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2352:x1876031364405248:12345-192.168.206.30@tcp:400:kworker.0 00000100:00080000:0.0:1789123060.131739:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789123060.131743:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789123060.131746:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789123060.134554:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2352:x1876031364404992:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 2984us (3185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123060.134568:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 30 00000100:00100000:2.0:1789123060.137495:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2352:x1876031364405248:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 5801us (6094us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123060.137509:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 15 00010000:00010000:2.0:1789123060.228912:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123061.258800:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789123061.828872:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789123061.828881:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f3406274800 from 4 10000000:01000000:1.0:1789123061.828886:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789123061.828937:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd33000/0x7e1648d68fc91b66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123061.828964:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f343bd33000/0x7e1648d68fc91b66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123061.828975:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f343bd33000/0x7e1648d68fc91b66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123061.829000:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381210240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789123061.829088:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123061.829134:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3407903a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789123061.829319:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381210240 00000100:00100000:0.0:1789123061.829329:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381210240 00000100:00100000:0.0:1789123061.829390:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789123061.829400:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:5838:x1876031381210240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789123061.829413:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123061.829426:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3435b52600/0x7e1648d68fc91b6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91b66 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123061.829449:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3435b52600/0x7e1648d68fc91b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91b66 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123061.829459:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3435b52600/0x7e1648d68fc91b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91b66 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123061.829469:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b52600, rc 0) 00000100:00100000:0.0:1789123061.829528:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381210240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123061.829545:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789123061.830030:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381210240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789123061.830049:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f343bd33000/0x7e1648d68fc91b66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b6d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123061.830060:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f343bd33000/0x7e1648d68fc91b66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91b6d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123061.830152:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381210368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789123061.830187:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123061.830236:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3407903a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789123061.830352:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381210368 00000100:00100000:2.0:1789123061.830358:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381210368 00000100:00100000:2.0:1789123061.830389:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789123061.830398:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381210368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789123061.830741:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381210368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 343us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123061.830750:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789123061.832121:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381210368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789123061.832195:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381210496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789123061.832276:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123061.832320:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3407903a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789123061.832396:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381210496 00000100:00100000:0.0:1789123061.832403:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381210496 00000100:00100000:0.0:1789123061.832457:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789123061.832466:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381210496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789123061.832696:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381210496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 231us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123061.832703:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789123061.834947:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381210496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789123061.837765:0:8588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8588:1876031381210624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789123061.838043:0:8588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123061.838091:0:8588:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34079030c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789123061.838383:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381210624 00000100:00100000:0.0:1789123061.838391:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381210624 00000100:00100000:0.0:1789123061.838439:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789123061.838448:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:8588:x1876031381210624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789123061.839001:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:8588:x1876031381210624:12345-0@lo:502:llog_process_th.0 Request processed in 551us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123061.839009:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789123061.840534:0:8588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8588:1876031381210624:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789123061.840581:0:8588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789123061.840592:0:8588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789123061.840594:0:8588:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789123061.840599:0:8588:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f3406274800 00000020:00000080:2.0:1789123061.840602:0:8588:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789123061.840923:0:8588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343568f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8588:1876031381210752:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789123061.840987:0:8588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123061.841023:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381210752 00000100:00100000:2.0:1789123061.841029:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381210752 00000100:00100000:2.0:1789123061.841080:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789123061.841089:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:8588:x1876031381210752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789123061.844909:0:8588:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34033563c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789123061.845311:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:8588:x1876031381210752:12345-0@lo:502:llog_process_th.0 Request processed in 4217us (4318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123061.845324:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789123061.845505:0:8588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343568f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8588:1876031381210752:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789123061.845543:0:8588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789123061.845551:0:8588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789123061.845553:0:8588:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789123061.845559:0:8588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789123061.846129:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789123061.846163:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789123061.846173:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd33000/0x7e1648d68fc91b66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b6d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123061.846184:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f343bd33000/0x7e1648d68fc91b66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b6d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123061.846194:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789123061.846204:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f343be04000 from 4 10000000:01000000:2.0:1789123061.846207:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789123061.846239:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f342d80b600/0x7e1648d68fc91b74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123061.846247:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f342d80b600/0x7e1648d68fc91b74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123061.846256:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f342d80b600/0x7e1648d68fc91b74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123061.846277:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343568ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381210880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789123061.846320:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123061.846359:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408def780 going to sleep for 11 seconds 00000100:00100000:0.0:1789123061.846430:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381210880 00000100:00100000:0.0:1789123061.846435:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381210880 00000100:00100000:0.0:1789123061.846530:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789123061.846538:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381210880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789123061.846548:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123061.846562:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3435b53000/0x7e1648d68fc91b7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91b74 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123061.846581:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3435b53000/0x7e1648d68fc91b7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91b74 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123061.846589:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3435b53000/0x7e1648d68fc91b7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91b74 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123061.846595:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53000, rc 0) 00000100:00100000:0.0:1789123061.846650:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381210880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123061.846658:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789123061.846701:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343568ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381210880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789123061.846847:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f342d80b600/0x7e1648d68fc91b74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b7b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123061.846858:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f342d80b600/0x7e1648d68fc91b74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91b7b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123061.846908:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381211008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789123061.846935:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123061.847135:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3301244f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789123061.847182:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381211008 00000100:00100000:2.0:1789123061.847187:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381211008 00000100:00100000:2.0:1789123061.847248:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789123061.847256:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381211008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789123061.847582:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381211008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 327us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123061.847590:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789123061.847662:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381211008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789123061.847695:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381211136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789123061.847735:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123061.847754:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3301244f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789123061.847813:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381211136 00000100:00100000:2.0:1789123061.847818:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381211136 00000100:00100000:2.0:1789123061.847846:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789123061.847852:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381211136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789123061.848243:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381211136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789123061.848415:0:8590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8590:1876031381211264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789123061.848902:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381211136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1047us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123061.848913:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789123061.848916:0:8590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123061.848946:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381211264 00000100:00100000:0.0:1789123061.849083:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381211264 00000100:00100000:0.0:1789123061.849161:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789123061.849171:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:8590:x1876031381211264:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789123061.849357:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:8590:x1876031381211264:12345-0@lo:502:llog_process_th.0 Request processed in 188us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123061.849365:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789123061.849437:0:8590:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3403356b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789123061.849523:0:8590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8590:1876031381211264:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789123061.849554:0:8590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789123061.849564:0:8590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789123061.849566:0:8590:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789123061.849575:0:8590:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f343be04000 00000020:00000080:0.0:1789123061.849578:0:8590:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789123061.850084:0:8590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8590:1876031381211392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789123061.850139:0:8590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123061.850168:0:8590:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3403356b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789123061.852208:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123061.852556:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381211392 00000100:00100000:3.0:1789123061.852565:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381211392 00000100:00100000:3.0:1789123061.852615:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364405376 00000100:00100000:3.0:1789123061.852618:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364405376 00000100:00100000:3.0:1789123061.852659:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789123061.852669:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:8590:x1876031381211392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789123061.852902:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:8590:x1876031381211392:12345-0@lo:502:llog_process_th.0 Request processed in 235us (2763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123061.852909:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789123061.852942:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 181 00000100:00100000:3.0:1789123061.854238:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+9:5592:x1876031364405376:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789123061.854256:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123061.854275:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3401514e00/0x7e1648d68fc91b82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f48c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123061.854306:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3401514e00/0x7e1648d68fc91b82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f48c expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123061.854317:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3401514e00/0x7e1648d68fc91b82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f48c expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123061.854326:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3401514e00, rc 0) 00000100:00100000:3.0:1789123061.854385:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+10:5592:x1876031364405376:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 Request processed in 158us (2186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123061.858013:0:8590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8590:1876031381211392:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789123061.858077:0:8590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789123061.858086:0:8590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789123061.858089:0:8590:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789123061.858095:0:8590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000100:00100000:3.0:1789123061.858384:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 181 00000020:01000000:1.0:1789123061.862366:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789123061.862403:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789123061.862415:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f342d80b600/0x7e1648d68fc91b74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b7b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123061.862427:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f342d80b600/0x7e1648d68fc91b74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b7b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789123061.862439:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789123061.862442:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f3408401800 from 4 10000000:01000000:1.0:1789123061.862445:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789123061.862496:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91b89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123061.862504:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91b89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123061.862516:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91b89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123061.862543:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381211520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789123061.862616:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123061.862706:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410be0540 going to sleep for 11 seconds 00000100:00100000:2.0:1789123061.862939:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381211520 00000100:00100000:2.0:1789123061.862953:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381211520 00000100:00100000:2.0:1789123061.863003:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789123061.863012:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381211520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789123061.863024:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123061.863036:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f342d80ac00/0x7e1648d68fc91b90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91b89 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123061.863057:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f342d80ac00/0x7e1648d68fc91b90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91b89 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123061.863079:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f342d80ac00/0x7e1648d68fc91b90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91b89 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123061.863087:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80ac00, rc 0) 00000100:00100000:2.0:1789123061.863130:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:5838:x1876031381211520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123061.863150:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789123061.863194:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381211520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789123061.863334:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91b89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b90 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123061.863345:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91b89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91b90 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123061.863405:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343568de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381211648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789123061.863435:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123061.863452:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408c6f900 going to sleep for 11 seconds 00000100:00100000:2.0:1789123061.863466:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381211648 00000100:00100000:2.0:1789123061.863476:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381211648 00000100:00100000:2.0:1789123061.863565:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789123061.863573:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:5838:x1876031381211648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789123061.864083:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:5838:x1876031381211648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 510us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123061.864091:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789123061.868951:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343568de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381211648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789123061.869016:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381211776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789123061.869099:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123061.869544:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410be0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789123061.869586:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381211776 00000100:00100000:1.0:1789123061.869592:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381211776 00000100:00100000:1.0:1789123061.869946:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789123061.869956:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:5838:x1876031381211776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789123061.870577:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:5838:x1876031381211776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 621us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123061.870586:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789123061.870665:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381211776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789123061.875182:0:8595:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343568c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8595:1876031381211904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789123061.875282:0:8595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123061.875328:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381211904 00000100:00100000:2.0:1789123061.875334:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381211904 00000100:00100000:2.0:1789123061.875383:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789123061.875394:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:8595:x1876031381211904:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789123061.875819:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:8595:x1876031381211904:12345-0@lo:502:llog_process_th.0 Request processed in 427us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123061.875827:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789123061.875889:0:8595:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340e0666c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789123061.875910:0:8595:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343568c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8595:1876031381211904:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789123061.875955:0:8595:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789123061.875964:0:8595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789123061.875966:0:8595:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789123061.875972:0:8595:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f3408401800 00000020:00000080:2.0:1789123061.875974:0:8595:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789123061.876052:0:8595:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343568c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8595:1876031381212032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789123061.876104:0:8595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123061.876119:0:8595:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340e0666c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123061.878513:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381212032 00000100:00100000:1.0:1789123061.878529:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381212032 00000100:00100000:1.0:1789123061.878597:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789123061.878608:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:8595:x1876031381212032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789123061.879150:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:8595:x1876031381212032:12345-0@lo:502:llog_process_th.0 Request processed in 543us (3043us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123061.879158:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789123061.881734:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123061.881767:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364405504 00000100:00100000:3.0:1789123061.881778:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364405504 00000100:00100000:3.0:1789123061.881828:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 187 00000100:00100000:3.0:1789123061.881839:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+10:5592:x1876031364405504:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789123061.882150:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+10:5592:x1876031364405504:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 Request processed in 312us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123061.882159:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 187 00000100:00100000:3.0:1789123061.887199:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123061.887232:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364405632 00000100:00100000:3.0:1789123061.887242:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364405632 00000100:00100000:3.0:1789123061.887307:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 188 00000100:00100000:3.0:1789123061.887327:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+10:5592:x1876031364405632:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789123061.887552:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+10:5592:x1876031364405632:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 Request processed in 227us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123061.887561:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 188 00000100:00100000:3.0:1789123061.887759:0:8595:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343568c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:8595:1876031381212032:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789123061.888601:0:8595:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789123061.888611:0:8595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123061.888614:0:8595:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789123061.888619:0:8595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789123061.888767:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789123061.889430:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789123061.889442:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91b89 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b90 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123061.889455:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91b89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b90 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123061.893480:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123061.893561:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364405760 00000100:00100000:2.0:1789123061.893577:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364405760 00000100:00100000:2.0:1789123061.893654:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 189 00000100:00100000:2.0:1789123061.893664:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+10:6142:x1876031364405760:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789123061.893903:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+10:6142:x1876031364405760:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 240us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123061.893912:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 189 00000100:00100000:3.0:1789123061.915319:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123061.915390:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364405888 00000100:00100000:2.0:1789123061.915399:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364405888 00000100:00100000:2.0:1789123061.915452:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 190 00000100:00100000:2.0:1789123061.915463:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+10:6142:x1876031364405888:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789123061.916008:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+10:6142:x1876031364405888:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 545us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123061.916018:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 190 00010000:00010000:3.0:1789123062.278514:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123062.788978:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343568e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381212160:0@lo:400:kworker.0 00000100:00100000:2.0:1789123062.789048:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123062.789109:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343568ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876031381212672:0@lo:400:kworker.0 00000100:00100000:2.0:1789123062.789137:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123062.789166:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789123062.789172:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343568c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876031381212288:0@lo:400:kworker.0 00000100:00100000:2.0:1789123062.789206:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123062.789225:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343568f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381212800:0@lo:400:kworker.0 00000100:00100000:2.0:1789123062.789249:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123062.789279:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343568c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381212416:0@lo:400:kworker.0 00000100:00100000:2.0:1789123062.789306:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123062.789341:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789123062.789347:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343568de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381212544:0@lo:400:kworker.0 00000100:00100000:2.0:1789123062.789369:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123062.789397:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381212672 00000100:00100000:2.0:1789123062.789404:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381212672 00000100:00100000:2.0:1789123062.789453:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381212288 00000100:00100000:2.0:1789123062.789457:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381212288 00000100:00100000:2.0:1789123062.789469:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381212416 00000100:00100000:2.0:1789123062.789471:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381212416 00000100:00100000:2.0:1789123062.789486:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789123062.789494:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876031381212672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123062.789543:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876031381212672:12345-0@lo:400:kworker.0 Request processed in 49us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123062.789551:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789123062.789567:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789123062.789573:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876031381212288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123062.789599:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876031381212288:12345-0@lo:400:kworker.0 Request processed in 27us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123062.789604:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789123062.789615:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789123062.789620:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381212416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123062.789679:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381212416:12345-0@lo:400:kworker.0 Request processed in 58us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123062.789683:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381212160 00000100:00100000:2.0:1789123062.789689:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789123062.789690:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381212160 00000100:00100000:2.0:1789123062.789716:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381212800 00000100:00100000:2.0:1789123062.789721:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381212800 00000100:00100000:0.0:1789123062.789727:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789123062.789736:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3304:x1876031381212160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123062.789763:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381212544 00000100:00100000:2.0:1789123062.789768:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381212544 00000100:00100000:0.0:1789123062.789800:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3304:x1876031381212160:12345-0@lo:400:kworker.0 Request processed in 65us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123062.789805:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789123062.789811:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789123062.789817:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184ca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381212800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123062.789854:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184ca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381212800:12345-0@lo:400:kworker.0 Request processed in 41us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123062.789861:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1789123062.789865:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789123062.789871:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789123062.789875:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789123062.789879:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789123062.789886:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381212544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123062.789919:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381212544:12345-0@lo:400:kworker.0 Request processed in 34us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123062.789925:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789123062.789928:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343568c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876031381212288:0@lo:400:kworker.0 00010000:00080000:0.0:1789123062.789948:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f343568f840 x1876031381212800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123062.789961:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343568f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381212800:0@lo:400:kworker.0 00010000:00080000:2.0:1789123062.789962:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f343568de00 x1876031381212544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123062.789976:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343568de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381212544:0@lo:400:kworker.0 00000100:00100000:0.0:1789123062.789977:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343568e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381212160:0@lo:400:kworker.0 00000100:00100000:2.0:1789123062.789997:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343568c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381212416:0@lo:400:kworker.0 00000100:00100000:0.0:1789123062.790000:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343568ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876031381212672:0@lo:400:kworker.0 00000100:00100000:1.0:1789123062.790351:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789123062.790362:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3418489680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381212928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789123062.790396:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123062.790478:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381212928 00000100:00100000:3.0:1789123062.790487:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381212928 00000100:00100000:3.0:1789123062.790524:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789123062.790532:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381212928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789123062.790559:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789123062.790608:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381212928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123062.790615:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789123062.790962:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3418489680 x1876031381212928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123062.790976:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3418489680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381212928:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789123063.304776:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123064.325144:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123064.325860:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789123064.325888:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381213056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789123064.325962:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123064.326019:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381213056 00000100:00100000:3.0:1789123064.326025:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381213056 00000100:00100000:3.0:1789123064.326086:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789123064.326102:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3418489e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381213056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789123064.326136:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789123064.326181:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3418489e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381213056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123064.326188:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1789123064.326208:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789123064.326253:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34184883c0 x1876031381213056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123080 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123064.326274:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381213056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789123065.249866:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123065.249922:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123065.249944:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123065.249972:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123065.250004:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364406144 00000100:00100000:3.0:1789123065.250015:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364406144 00000100:00100000:3.0:1789123065.250095:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 34 00000100:00100000:3.0:1789123065.250105:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3418488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2354:x1876031364406144:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123065.250306:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364406272 00000100:00100000:0.0:1789123065.250311:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364406272 00000100:00100000:0.0:1789123065.250344:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364406400 00000100:00100000:0.0:1789123065.250347:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364406400 00000100:00100000:0.0:1789123065.250371:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 18 00000100:00100000:0.0:1789123065.250379:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2354:x1876031364406272:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123065.250449:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2354:x1876031364406272:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 71us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123065.250457:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 18 00000100:00100000:0.0:1789123065.250474:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 19 00000100:00100000:0.0:1789123065.250481:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f341848a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2354:x1876031364406400:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123065.250507:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f341848a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2354:x1876031364406400:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 27us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123065.250528:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 19 00000100:00100000:3.0:1789123065.250938:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3418488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2354:x1876031364406144:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 833us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123065.250947:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 34 00000100:00080000:3.0:1789123065.250965:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789123065.250970:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789123065.250972:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789123065.251057:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364406016 00000100:00100000:1.0:1789123065.251062:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364406016 00000100:00100000:1.0:1789123065.251101:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 192 00000100:00100000:1.0:1789123065.251109:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+10:2354:x1876031364406016:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123065.251139:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+10:2354:x1876031364406016:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 32us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123065.251157:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 192 00010000:00010000:1.0:1789123065.349387:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123066.373616:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789123066.559586:0:8806:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1789123067.397773:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123067.910072:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381213440:0@lo:400:kworker.0 00000100:00100000:3.0:1789123067.910143:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123067.910223:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f341848b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381213952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789123067.910253:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123067.910297:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789123067.910304:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381213568:0@lo:400:kworker.0 00000100:00100000:3.0:1789123067.910329:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123067.910361:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381213952 00000100:00100000:3.0:1789123067.910368:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381213952 00000100:00100000:3.0:1789123067.910422:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789123067.910432:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381213952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789123067.910469:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789123067.910514:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381213952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123067.910521:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789123067.910543:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381213568 00000100:00100000:3.0:1789123067.910546:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381213568 00000100:00100000:3.0:1789123067.910572:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789123067.910579:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f341848b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381213568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123067.910611:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f341848b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381213568:12345-0@lo:400:kworker.0 Request processed in 33us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123067.910618:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1789123067.910657:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789123067.910660:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789123067.910702:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34049a6940 x1876031381213568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123067.910717:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381213568:0@lo:400:kworker.0 00010000:00080000:3.0:1789123067.910728:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f341848b0c0 x1876031381213952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123067.910754:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f341848b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381213952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789123067.911215:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876031381213312:0@lo:400:kworker.0 00000100:00100000:2.0:1789123067.911253:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123067.911292:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381213824:0@lo:400:kworker.0 00000100:00100000:2.0:1789123067.911315:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123067.911335:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789123067.911341:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381213184:0@lo:400:kworker.0 00000100:00100000:2.0:1789123067.911378:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123067.911405:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381213696:0@lo:400:kworker.0 00000100:00100000:2.0:1789123067.911428:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123067.911460:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381213184 00000100:00100000:2.0:1789123067.911465:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381213184 00000100:00100000:2.0:1789123067.911497:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789123067.911505:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3305:x1876031381213184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123067.911545:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3305:x1876031381213184:12345-0@lo:400:kworker.0 Request processed in 41us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123067.911551:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789123067.911578:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381213440 00000100:00100000:2.0:1789123067.911583:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381213440 00000100:00100000:2.0:1789123067.911611:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381213312 00000100:00100000:2.0:1789123067.911614:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381213312 00000100:00100000:2.0:1789123067.911650:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381213696 00000100:00100000:2.0:1789123067.911653:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381213696 00000100:00100000:2.0:1789123067.911669:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789123067.911689:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f341848a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381213440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123067.911723:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f341848a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381213440:12345-0@lo:400:kworker.0 Request processed in 36us (1580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123067.911728:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789123067.911738:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789123067.911744:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876031381213312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123067.911768:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876031381213312:12345-0@lo:400:kworker.0 Request processed in 25us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123067.911774:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789123067.911783:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789123067.911800:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876031381213696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123067.911828:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876031381213696:12345-0@lo:400:kworker.0 Request processed in 28us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123067.911833:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789123067.912893:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381213440:0@lo:400:kworker.0 00000100:00100000:0.0:1789123067.912975:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381213824 00000100:00100000:0.0:1789123067.912980:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381213824 00000100:00100000:0.0:1789123067.913016:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789123067.913042:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381213824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123067.913093:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381213824:12345-0@lo:400:kworker.0 Request processed in 60us (1776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123067.913100:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1789123067.913695:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789123067.913724:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381213184:0@lo:400:kworker.0 00000100:00100000:2.0:1789123067.913738:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381213696:0@lo:400:kworker.0 00000100:00100000:2.0:1789123067.913747:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876031381213312:0@lo:400:kworker.0 00010000:00080000:2.0:1789123067.913758:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34049a4f00 x1876031381213824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123067.913768:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381213824:0@lo:400:kworker.0 00010000:00010000:1.0:1789123068.423738:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123069.445907:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381214080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789123069.445991:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789123069.446059:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123069.446080:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381214080 00000100:00100000:0.0:1789123069.446088:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381214080 00000100:00100000:0.0:1789123069.446147:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789123069.446156:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381214080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789123069.446188:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789123069.446229:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f512c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381214080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123069.446236:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1789123069.446273:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3409cb70c0 x1876031381214080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123085 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123069.446291:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381214080:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789123069.446314:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789123070.374345:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123070.374439:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123070.374469:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364406656 00000100:00100000:2.0:1789123070.374478:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364406656 00000100:00100000:2.0:1789123070.374539:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 38 00000100:00100000:2.0:1789123070.374549:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2352:x1876031364406656:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1789123070.374618:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2352:x1876031364406656:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 70us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123070.374624:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 38 00000100:00100000:1.0:1789123070.374802:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364406528 00000100:00100000:1.0:1789123070.374807:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364406528 00000100:00100000:1.0:1789123070.374843:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 194 00000100:00100000:1.0:1789123070.374850:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+10:2352:x1876031364406528:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123070.374884:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+10:2352:x1876031364406528:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 35us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123070.374891:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 194 00000100:00080000:1.0:1789123070.374917:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789123070.379069:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123070.379173:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123070.386782:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364406912 00000100:00100000:1.0:1789123070.386782:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364406784 00000100:00100000:2.0:1789123070.386798:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364406912 00000100:00100000:1.0:1789123070.386798:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364406784 00000100:00100000:2.0:1789123070.387000:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 10 00000100:00100000:2.0:1789123070.387013:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2351:x1876031364406912:12345-192.168.206.30@tcp:9:kworker.0 00000020:00000080:2.0:1789123070.387064:0:6688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc91ad3 00000100:00080000:2.0:1789123070.387220:0:6688:0:(import.c:65:import_set_state_nolock()) ffff9f3301276000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789123070.387263:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:3.0:1789123070.387437:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789123070.387443:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789123070.387504:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 11 00000100:00100000:1.0:1789123070.387523:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2351:x1876031364406784:12345-192.168.206.30@tcp:9:kworker.0 00000020:00000080:1.0:1789123070.387548:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc91acc 00000100:00080000:1.0:1789123070.387558:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9f3435928800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789123070.387592:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789123070.387824:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+2:2351:x1876031364406912:12345-192.168.206.30@tcp:9:kworker.0 Request processed in 811us (8647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123070.387833:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 10 00000100:00100000:1.0:1789123070.387860:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+2:2351:x1876031364406784:12345-192.168.206.30@tcp:9:kworker.0 Request processed in 339us (8798us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123070.387870:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 11 00010000:00010000:1.0:1789123070.387896:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123070.389095:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123070.468754:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789123070.851132:0:9051:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-server.virtnet: executing yml_node 00010000:00010000:0.0:1789123071.494235:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789123072.066266:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 64de9449-4320-4c9f-abcb-230edd2b11ae 00000020:00000080:2.0:1789123072.066276:0:6710:0:(genops.c:885:class_export_put()) final put ffff9f343592b000/64de9449-4320-4c9f-abcb-230edd2b11ae 00000020:00000080:3.0:1789123072.066356:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9f343592b000/64de9449-4320-4c9f-abcb-230edd2b11ae for lustre-OST0000 00000020:00000080:3.0:1789123072.066410:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f3435928800 for lustre-OST0000 00010000:00010000:0.0:1789123072.517701:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123073.028979:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789123073.029002:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f341848b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381214208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789123073.029077:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123073.029255:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381214208 00000100:00100000:3.0:1789123073.029262:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381214208 00000100:00100000:3.0:1789123073.029324:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789123073.029334:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381214208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789123073.029366:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789123073.029413:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381214208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123073.029420:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1789123073.029458:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f341848b0c0 x1876031381214208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123073.029476:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f341848b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381214208:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789123073.029486:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789123073.029915:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f341848b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381214336:0@lo:400:kworker.0 00000100:00100000:1.0:1789123073.029950:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123073.029977:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f341848b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381214848:0@lo:400:kworker.0 00000100:00100000:1.0:1789123073.029999:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123073.030030:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789123073.030036:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f341848bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381214720:0@lo:400:kworker.0 00000100:00100000:1.0:1789123073.030057:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123073.030081:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381214336 00000100:00100000:1.0:1789123073.030085:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381214336 00000100:00100000:1.0:1789123073.030110:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789123073.030117:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3305:x1876031381214336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123073.030150:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3305:x1876031381214336:12345-0@lo:400:kworker.0 Request processed in 33us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123073.030156:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789123073.030178:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381214848 00000100:00100000:1.0:1789123073.030181:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381214848 00000100:00100000:1.0:1789123073.030220:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789123073.030226:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876031381214848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123073.030270:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876031381214848:12345-0@lo:400:kworker.0 Request processed in 44us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123073.030277:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789123073.030298:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381214720 00000100:00100000:1.0:1789123073.030301:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381214720 00000100:00100000:1.0:1789123073.030331:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789123073.030338:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381214720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123073.030368:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381214720:12345-0@lo:400:kworker.0 Request processed in 30us (309us total) trans 0 rc 0/0 00000100:00080000:0.0:1789123073.030369:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789123073.030375:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1789123073.030382:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789123073.030410:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f341848bc00 x1876031381214720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123073.030415:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3418489a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381214464:0@lo:400:kworker.0 00000100:00100000:0.0:1789123073.030432:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f341848bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381214720:0@lo:400:kworker.0 00000100:00100000:0.0:1789123073.030446:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f341848b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381214336:0@lo:400:kworker.0 00000100:00100000:1.0:1789123073.030451:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123073.030463:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f341848b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381214848:0@lo:400:kworker.0 00000100:00100000:1.0:1789123073.030477:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789123073.030486:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3418488780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381214592:0@lo:400:kworker.0 00000100:00100000:0.0:1789123073.030502:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381214464 00000100:00100000:0.0:1789123073.030507:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381214464 00000100:00100000:1.0:1789123073.030509:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123073.030544:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381214592 00000100:00100000:1.0:1789123073.030547:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381214592 00000100:00100000:0.0:1789123073.030555:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789123073.030566:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381214464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123073.030579:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789123073.030588:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381214592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123073.030618:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381214464:12345-0@lo:400:kworker.0 Request processed in 54us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123073.030645:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789123073.030656:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381214592:12345-0@lo:400:kworker.0 Request processed in 67us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123073.030663:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1789123073.030673:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789123073.030701:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3418488780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381214592:0@lo:400:kworker.0 00000100:00100000:1.0:1789123073.030710:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3418489a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381214464:0@lo:400:kworker.0 00010000:00010000:0.0:1789123073.541073:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123074.565116:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381214976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789123074.565198:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789123074.565198:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123074.565939:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381214976 00000100:00100000:3.0:1789123074.565961:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381214976 00000100:00100000:3.0:1789123074.566125:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789123074.566139:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381214976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789123074.566191:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789123074.567596:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381214976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1449us (2391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123074.567658:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1789123074.567681:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34049a6580 x1876031381214976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123090 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123074.567714:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381214976:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1789123075.119544:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 64de9449-4320-4c9f-abcb-230edd2b11ae 00000020:00000080:3.0:1789123075.119553:0:7644:0:(genops.c:885:class_export_put()) final put ffff9f3301273000/64de9449-4320-4c9f-abcb-230edd2b11ae 00000020:00000080:1.0:1789123075.119618:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f3301273000/64de9449-4320-4c9f-abcb-230edd2b11ae for lustre-OST0001 00000020:00000080:1.0:1789123075.119684:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f3301276000 for lustre-OST0001 00000001:02000400:2.0:1789123075.242875:0:9246:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.138 00000100:00100000:1.0:1789123075.483585:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123075.483729:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123075.483813:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364407168 00000100:00100000:0.0:1789123075.483822:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364407168 00000100:00100000:0.0:1789123075.483906:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 42 00000100:00100000:0.0:1789123075.483917:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2352:x1876031364407168:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123075.484012:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2352:x1876031364407168:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 79us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123075.484019:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 42 00000100:00080000:1.0:1789123075.484192:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789123075.485867:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364407040 00000100:00100000:2.0:1789123075.485880:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364407040 00000100:00100000:0.0:1789123075.486213:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 196 00000100:00100000:0.0:1789123075.486225:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+10:2352:x1876031364407040:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123075.486323:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+10:2352:x1876031364407040:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 100us (2745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123075.486345:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 196 00010000:00010000:0.0:1789123075.594082:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123076.613221:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123077.637097:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789123077.866161:0:9344:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.138 00000100:00100000:3.0:1789123078.148954:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3418488780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876031381215232:0@lo:400:kworker.0 00000100:00100000:1.0:1789123078.149016:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3418489a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd41f4a0-f4e3-41a1-856e-0c34af912023:3303:1876031381215104:0@lo:400:kworker.0 00000100:00100000:0.0:1789123078.149149:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f341848b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381215488:0@lo:400:kworker.0 00000100:00100000:1.0:1789123078.150086:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123078.150120:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123078.150548:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3418489680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381215744:0@lo:400:kworker.0 00000100:00100000:1.0:1789123078.150549:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f341848bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876031381215616:0@lo:400:kworker.0 00000100:00100000:1.0:1789123078.150603:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123078.150609:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123078.150673:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789123078.150683:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f341848b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381215360:0@lo:400:kworker.0 00000100:00100000:1.0:1789123078.150701:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381215104 00000100:00100000:1.0:1789123078.150712:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381215104 00000100:00100000:3.0:1789123078.150716:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123078.150742:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3301f51a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381215872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789123078.150769:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789123078.150773:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123078.150783:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3303:x1876031381215104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123078.150815:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381215232 00000100:00100000:3.0:1789123078.150820:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381215232 00000100:00100000:1.0:1789123078.150847:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3303:x1876031381215104:12345-0@lo:400:kworker.0 Request processed in 66us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123078.150857:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789123078.150859:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381215616 00000100:00100000:3.0:1789123078.150864:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381215616 00000100:00100000:1.0:1789123078.150893:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381215360 00000100:00100000:1.0:1789123078.150897:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381215360 00000100:00100000:1.0:1789123078.150916:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789123078.150923:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f341848a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876031381215232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123078.150950:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789123078.150960:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f341848ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381215360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123078.150967:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f341848a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876031381215232:12345-0@lo:400:kworker.0 Request processed in 42us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123078.150998:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789123078.151016:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f341848ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381215360:12345-0@lo:400:kworker.0 Request processed in 57us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123078.151018:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789123078.151027:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876031381215616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123078.151060:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876031381215616:12345-0@lo:400:kworker.0 Request processed in 34us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123078.151066:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789123078.151087:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381215744 00000100:00100000:1.0:1789123078.151091:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381215744 00000100:00100000:1.0:1789123078.151119:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789123078.151124:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3418488b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381215744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123078.151155:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3418488b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381215744:12345-0@lo:400:kworker.0 Request processed in 31us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123078.151161:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1789123078.151180:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789123078.151185:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789123078.151211:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789123078.151218:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3418489a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd41f4a0-f4e3-41a1-856e-0c34af912023:3303:1876031381215104:0@lo:400:kworker.0 00000100:00100000:1.0:1789123078.151236:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f341848bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876031381215616:0@lo:400:kworker.0 00000100:00100000:3.0:1789123078.151240:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381215872 00000100:00100000:3.0:1789123078.151245:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381215872 00000100:00100000:1.0:1789123078.151274:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f341848b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381215360:0@lo:400:kworker.0 00000100:00100000:3.0:1789123078.151278:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789123078.151288:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d54780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381215872:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789123078.151291:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3418488780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876031381215232:0@lo:400:kworker.0 00010000:00080000:1.0:1789123078.151305:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3418489680 x1876031381215744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123078.151315:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3418489680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381215744:0@lo:400:kworker.0 00002000:00000024:3.0:1789123078.151460:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789123078.151516:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d54780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381215872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 230us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123078.151523:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1789123078.152522:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3301f51a40 x1876031381215872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123078.152550:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3301f51a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381215872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789123078.155713:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123078.157203:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381215488 00000100:00100000:1.0:1789123078.157220:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381215488 00000100:00100000:1.0:1789123078.157313:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789123078.157324:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f50780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381215488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123078.157434:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f50780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381215488:12345-0@lo:400:kworker.0 Request processed in 111us (1732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123078.157442:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1789123078.157500:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f341848b0c0 x1876031381215488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123078.157518:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f341848b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381215488:0@lo:400:kworker.0 00000100:00080000:0.0:1789123078.157589:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789123078.661042:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123079.685338:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789123079.685371:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34356730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381216000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789123079.685474:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123079.685668:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381216000 00000100:00100000:2.0:1789123079.685680:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381216000 00010000:00010000:0.0:1789123079.685721:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123079.685751:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789123079.685765:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d55a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381216000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789123079.685814:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123079.686308:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d55a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381216000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123079.686318:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1789123079.686655:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34356730c0 x1876031381216000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123095 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123079.697430:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34356730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381216000:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1789123080.471371:0:9441:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.138 00000100:00100000:2.0:1789123080.611910:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123080.612008:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123080.612099:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364407424 00000100:00100000:3.0:1789123080.612112:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364407424 00000100:00100000:3.0:1789123080.612198:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 46 00000100:00100000:3.0:1789123080.612211:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34356712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2352:x1876031364407424:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1789123080.612309:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34356712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2352:x1876031364407424:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 101us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123080.612317:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 46 00000100:00100000:0.0:1789123080.612666:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364407296 00000100:00100000:0.0:1789123080.612673:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364407296 00000100:00100000:0.0:1789123080.612710:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 198 00000100:00100000:0.0:1789123080.612718:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+10:2352:x1876031364407296:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123080.612757:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+10:2352:x1876031364407296:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 41us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123080.612764:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 198 00000100:00080000:2.0:1789123080.613187:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789123080.709156:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123081.732764:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789123082.320865:0:9490:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 11 06:38:00 EDT 2026 00010000:00010000:0.0:1789123082.756858:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123083.269745:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381216128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789123083.269817:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123083.269917:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381216128 00000100:00100000:1.0:1789123083.269924:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381216128 00000100:00100000:1.0:1789123083.269991:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789123083.270001:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381216128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789123083.270038:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789123083.270093:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381216128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123083.270100:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1789123083.270120:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789123083.270147:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34049a7480 x1876031381216128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123083.270179:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381216128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789123083.272715:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435673c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876031381216384:0@lo:400:kworker.0 00000100:00100000:3.0:1789123083.272782:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123083.272834:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789123083.272840:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435671a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381216256:0@lo:400:kworker.0 00000100:00100000:3.0:1789123083.272889:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123083.272914:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381216768:0@lo:400:kworker.0 00000100:00100000:3.0:1789123083.272948:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123083.273011:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381216384 00000100:00100000:3.0:1789123083.273018:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381216384 00000100:00100000:3.0:1789123083.273058:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381216768 00000100:00100000:3.0:1789123083.273061:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381216768 00000100:00100000:3.0:1789123083.273237:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789123083.273248:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d56940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876031381216384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123083.273383:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d56940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876031381216384:12345-0@lo:400:kworker.0 Request processed in 137us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123083.273391:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789123083.273410:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789123083.273417:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876031381216768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123083.273444:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876031381216768:12345-0@lo:400:kworker.0 Request processed in 29us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123083.273450:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789123083.273491:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381216768:0@lo:400:kworker.0 00000100:00100000:3.0:1789123083.273501:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435673c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876031381216384:0@lo:400:kworker.0 00000100:00100000:1.0:1789123083.273737:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435672940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381216512:0@lo:400:kworker.0 00000100:00100000:1.0:1789123083.273767:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123083.273794:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789123083.273799:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34356730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381216640:0@lo:400:kworker.0 00000100:00100000:1.0:1789123083.273821:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123083.273974:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381216512 00000100:00100000:3.0:1789123083.273979:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381216512 00000100:00100000:3.0:1789123083.274010:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789123083.274015:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381216512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123083.274053:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381216512:12345-0@lo:400:kworker.0 Request processed in 38us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123083.274058:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1789123083.274561:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789123083.275026:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381216256 00000100:00100000:1.0:1789123083.275032:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381216256 00000100:00100000:2.0:1789123083.277085:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381216640 00000100:00100000:2.0:1789123083.277097:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381216640 00000100:00100000:2.0:1789123083.277163:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789123083.277172:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381216640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123083.277250:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381216640:12345-0@lo:400:kworker.0 Request processed in 80us (3428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123083.277257:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1789123083.277294:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789123083.279833:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34356730c0 x1876031381216640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123083.280619:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34356730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381216640:0@lo:400:kworker.0 00000100:00100000:0.0:1789123083.280657:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435672940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381216512:0@lo:400:kworker.0 00000100:00100000:3.0:1789123083.281227:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789123083.281242:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3305:x1876031381216256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123083.281544:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3305:x1876031381216256:12345-0@lo:400:kworker.0 Request processed in 306us (8652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123083.281552:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789123083.281622:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435671a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381216256:0@lo:400:kworker.0 00010000:00010000:0.0:1789123083.781726:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123084.807924:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435672580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381216896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789123084.808013:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123084.808149:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381216896 00000100:00100000:2.0:1789123084.808157:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381216896 00000100:00100000:2.0:1789123084.808213:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789123084.808223:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381216896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789123084.808269:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123084.808316:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381216896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123084.808323:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1789123084.808366:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3435672580 x1876031381216896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123084.808383:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435672580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381216896:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789123084.812418:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123085.726049:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123085.726108:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123085.726138:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364407552 00000100:00100000:2.0:1789123085.726147:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364407552 00000100:00100000:2.0:1789123085.726193:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 200 00000100:00100000:2.0:1789123085.726203:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+10:2353:x1876031364407552:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1789123085.726284:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+10:2353:x1876031364407552:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 82us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123085.726291:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 200 00000100:00100000:3.0:1789123085.727672:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364407680 00000100:00100000:3.0:1789123085.727684:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364407680 00000100:00100000:3.0:1789123085.727752:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 50 00000100:00100000:3.0:1789123085.727762:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2353:x1876031364407680:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1789123085.727834:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2353:x1876031364407680:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 74us (1794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123085.727842:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 50 00000100:00080000:2.0:1789123085.728163:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789123085.829010:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123086.853805:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123087.883501:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123088.389098:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34356730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381217408:0@lo:400:kworker.0 00000100:00100000:2.0:1789123088.389183:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123088.389241:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789123088.389247:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435672940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876031381217280:0@lo:400:kworker.0 00000100:00100000:2.0:1789123088.389274:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123088.389306:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381217280 00000100:00100000:2.0:1789123088.389313:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381217280 00000100:00100000:2.0:1789123088.389371:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789123088.389381:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343551b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876031381217280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123088.389431:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343551b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876031381217280:12345-0@lo:400:kworker.0 Request processed in 52us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123088.389438:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1789123088.389459:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789123088.389503:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435672940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876031381217280:0@lo:400:kworker.0 00000100:00100000:0.0:1789123088.391019:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435672580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381217024:0@lo:400:kworker.0 00000100:00100000:0.0:1789123088.391090:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123088.391130:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435673c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876031381217536:0@lo:400:kworker.0 00000100:00100000:0.0:1789123088.391156:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123088.391181:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789123088.391186:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435671a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381217152:0@lo:400:kworker.0 00000100:00100000:0.0:1789123088.391205:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123088.391221:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381217664:0@lo:400:kworker.0 00000100:00100000:0.0:1789123088.391242:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123088.391292:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381217024 00000100:00100000:0.0:1789123088.391298:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381217024 00000100:00100000:0.0:1789123088.391337:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789123088.391344:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3302:x1876031381217024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123088.391387:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3302:x1876031381217024:12345-0@lo:400:kworker.0 Request processed in 43us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123088.391394:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789123088.391421:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381217536 00000100:00100000:0.0:1789123088.391425:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381217536 00000100:00100000:0.0:1789123088.391454:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381217152 00000100:00100000:0.0:1789123088.391456:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381217152 00000100:00100000:0.0:1789123088.391473:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789123088.391479:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f52d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876031381217536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123088.391521:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f52d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876031381217536:12345-0@lo:400:kworker.0 Request processed in 43us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123088.391528:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789123088.391539:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789123088.391544:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381217152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123088.391568:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381217152:12345-0@lo:400:kworker.0 Request processed in 24us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123088.391574:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789123088.391594:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381217408 00000100:00100000:0.0:1789123088.391597:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381217408 00000100:00100000:0.0:1789123088.391619:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381217664 00000100:00100000:0.0:1789123088.391622:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381217664 00000100:00100000:0.0:1789123088.391661:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789123088.391667:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343551a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381217408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123088.391700:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343551a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381217408:12345-0@lo:400:kworker.0 Request processed in 34us (2518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123088.391706:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789123088.391717:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789123088.391723:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f50f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381217664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123088.391748:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f50f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381217664:12345-0@lo:400:kworker.0 Request processed in 26us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123088.391753:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789123088.391778:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789123088.391781:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789123088.391783:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789123088.391809:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435671a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381217152:0@lo:400:kworker.0 00010000:00080000:0.0:1789123088.392292:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3435673480 x1876031381217664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123088.392303:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381217664:0@lo:400:kworker.0 00000100:00100000:0.0:1789123088.392313:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435672580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381217024:0@lo:400:kworker.0 00000100:00100000:0.0:1789123088.392322:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435673c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876031381217536:0@lo:400:kworker.0 00010000:00080000:0.0:1789123088.392356:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34356730c0 x1876031381217408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123088.392365:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34356730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381217408:0@lo:400:kworker.0 00000100:00100000:3.0:1789123088.404705:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f340665c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381217792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789123088.404770:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123088.404832:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381217792 00000100:00100000:3.0:1789123088.404838:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381217792 00000100:00100000:3.0:1789123088.404889:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789123088.404898:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381217792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789123088.404937:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789123088.404974:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381217792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123088.404980:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1789123088.405014:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f340665c3c0 x1876031381217792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123088.405029:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f340665c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381217792:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789123088.900724:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123089.924923:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123089.928246:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789123089.928286:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381217920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789123089.928381:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123089.928482:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381217920 00000100:00100000:1.0:1789123089.928492:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381217920 00000100:00100000:1.0:1789123089.928555:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789123089.928566:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381217920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789123089.928608:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789123089.928689:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381217920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123089.928697:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1789123089.928754:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34049a7c00 x1876031381217920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123105 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123089.928776:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381217920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789123090.855972:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123090.856032:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123090.856117:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364407936 00000100:00100000:1.0:1789123090.856138:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364407936 00000100:00100000:1.0:1789123090.856256:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 54 00000100:00100000:1.0:1789123090.856282:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343551a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2352:x1876031364407936:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123090.856397:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343551a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2352:x1876031364407936:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 117us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123090.856405:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 54 00000100:00100000:3.0:1789123090.857394:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364407808 00000100:00100000:3.0:1789123090.857406:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364407808 00000100:00100000:3.0:1789123090.857468:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 202 00000100:00100000:3.0:1789123090.857493:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+10:2352:x1876031364407808:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1789123090.857565:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+10:2352:x1876031364407808:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 75us (1613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123090.857572:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 202 00000100:00080000:2.0:1789123090.858008:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789123090.949130:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123091.972894:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123093.001668:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123093.510377:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343551bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381218304:0@lo:400:kworker.0 00000100:00100000:3.0:1789123093.510490:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123093.510573:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789123093.510581:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343551b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381218432:0@lo:400:kworker.0 00000100:00100000:3.0:1789123093.510616:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123093.512408:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435519a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381218048:0@lo:400:kworker.0 00000100:00100000:0.0:1789123093.512492:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123093.512550:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343551ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876031381218560:0@lo:400:kworker.0 00000100:00100000:0.0:1789123093.512581:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123093.512612:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789123093.512619:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435518780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381218176:0@lo:400:kworker.0 00000100:00100000:0.0:1789123093.512673:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123093.512695:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343551a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381218688:0@lo:400:kworker.0 00000100:00100000:0.0:1789123093.512723:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123093.512768:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381218304 00000100:00100000:0.0:1789123093.512778:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381218304 00000100:00100000:0.0:1789123093.513041:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381218560 00000100:00100000:2.0:1789123093.513060:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381218432 00000100:00100000:0.0:1789123093.513062:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381218560 00000100:00100000:2.0:1789123093.513064:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381218432 00000100:00100000:2.0:1789123093.513097:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381218688 00000100:00100000:2.0:1789123093.513100:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381218688 00000100:00100000:2.0:1789123093.513126:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789123093.513137:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381218432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123093.513156:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381218176 00000100:00100000:0.0:1789123093.513158:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381218176 00000100:00100000:0.0:1789123093.513170:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789123093.513175:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381218304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123093.513211:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381218432:12345-0@lo:400:kworker.0 Request processed in 76us (2593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123093.513220:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789123093.513239:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789123093.513245:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381218688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123093.513259:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381218048 00000100:00100000:3.0:1789123093.513263:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381218048 00000100:00100000:3.0:1789123093.513294:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789123093.513302:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3302:x1876031381218048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123093.513341:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3302:x1876031381218048:12345-0@lo:400:kworker.0 Request processed in 40us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123093.513347:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789123093.513522:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381218304:12345-0@lo:400:kworker.0 Request processed in 346us (3032us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123093.513530:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789123093.513544:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789123093.513550:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876031381218560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123093.513579:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876031381218560:12345-0@lo:400:kworker.0 Request processed in 30us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123093.513584:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789123093.513595:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789123093.513601:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f51e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381218176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123093.513642:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f51e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381218176:12345-0@lo:400:kworker.0 Request processed in 25us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123093.513649:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1789123093.513677:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789123093.513681:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789123093.513684:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789123093.514196:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381218688:12345-0@lo:400:kworker.0 Request processed in 940us (1461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123093.514219:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789123093.514365:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435519a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381218048:0@lo:400:kworker.0 00000100:00100000:3.0:1789123093.514401:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343551ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876031381218560:0@lo:400:kworker.0 00000100:00100000:3.0:1789123093.514436:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435518780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381218176:0@lo:400:kworker.0 00010000:00080000:3.0:1789123093.514452:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f343551a1c0 x1876031381218688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123093.514464:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343551a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381218688:0@lo:400:kworker.0 00010000:00080000:3.0:1789123093.514498:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f343551b840 x1876031381218432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123093.514524:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343551b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381218432:0@lo:400:kworker.0 00000100:00100000:3.0:1789123093.514540:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343551bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381218304:0@lo:400:kworker.0 00000100:00100000:3.0:1789123093.514927:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381218816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789123093.515048:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123093.515210:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381218816 00000100:00100000:0.0:1789123093.515218:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381218816 00000100:00100000:0.0:1789123093.515264:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789123093.515273:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381218816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789123093.515328:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789123093.515603:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381218816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 329us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123093.515621:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1789123093.515948:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34049a7c00 x1876031381218816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123109 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123093.516042:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381218816:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789123094.034980:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123095.044869:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381218944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789123095.044964:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123095.045152:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381218944 00000100:00100000:1.0:1789123095.045160:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381218944 00000100:00100000:1.0:1789123095.045241:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789123095.045253:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381218944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789123095.045292:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789123095.045358:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381218944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123095.045366:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1789123095.045403:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34049a7840 x1876031381218944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123111 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123095.045424:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381218944:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789123095.045554:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789123095.053566:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123095.974685:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123095.974783:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123095.975024:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364408064 00000100:00100000:1.0:1789123095.975034:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364408064 00000100:00100000:1.0:1789123095.975082:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 204 00000100:00100000:1.0:1789123095.975092:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+10:2352:x1876031364408064:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123095.975159:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+10:2352:x1876031364408064:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 69us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123095.975166:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 204 00000100:00100000:2.0:1789123095.975505:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364408192 00000100:00100000:2.0:1789123095.975511:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364408192 00000100:00100000:2.0:1789123095.975566:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 58 00000100:00100000:2.0:1789123095.975574:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435518b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2352:x1876031364408192:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1789123095.975623:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435518b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2352:x1876031364408192:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 50us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123095.975650:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 58 00000100:00080000:1.0:1789123095.977570:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789123096.068959:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123097.094996:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123098.116971:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123098.628898:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435518000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381219456:0@lo:400:kworker.0 00000100:00100000:1.0:1789123098.628898:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876031381219200:0@lo:400:kworker.0 00000100:00100000:3.0:1789123098.629148:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435519680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381219072:0@lo:400:kworker.0 00000100:00100000:0.0:1789123098.629227:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435519e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381219328:0@lo:400:kworker.0 00000100:00100000:2.0:1789123098.635041:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123098.635183:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381219456 00000100:00100000:2.0:1789123098.635191:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381219456 00000100:00100000:2.0:1789123098.635241:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789123098.635250:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343551bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381219456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123098.635300:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343551bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381219456:12345-0@lo:400:kworker.0 Request processed in 52us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123098.635307:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1789123098.635348:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3435518000 x1876031381219456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123098.635362:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435518000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381219456:0@lo:400:kworker.0 00000100:00080000:2.0:1789123098.635389:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789123098.645679:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123098.645744:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343551b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381219712:0@lo:400:kworker.0 00000100:00100000:1.0:1789123098.645798:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123098.645838:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381219712 00000100:00100000:2.0:1789123098.645847:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381219712 00000100:00100000:2.0:1789123098.645922:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789123098.645931:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381219712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123098.645990:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381219712:12345-0@lo:400:kworker.0 Request processed in 61us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123098.645997:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789123098.646016:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381219200 00000100:00100000:2.0:1789123098.646020:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381219200 00000100:00080000:1.0:1789123098.646027:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789123098.646043:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789123098.646048:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876031381219200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123098.646079:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876031381219200:12345-0@lo:400:kworker.0 Request processed in 30us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123098.646085:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1789123098.647406:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f343551b480 x1876031381219712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123098.647424:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343551b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381219712:0@lo:400:kworker.0 00000100:00100000:1.0:1789123098.647466:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876031381219200:0@lo:400:kworker.0 00000100:00100000:3.0:1789123098.648506:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123098.648567:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435518f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876031381219584:0@lo:400:kworker.0 00000100:00100000:3.0:1789123098.648608:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123098.648739:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381219072 00000100:00100000:2.0:1789123098.648748:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381219072 00000100:00100000:2.0:1789123098.648817:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789123098.648826:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3302:x1876031381219072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123098.648890:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3302:x1876031381219072:12345-0@lo:400:kworker.0 Request processed in 65us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123098.648898:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789123098.648931:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381219584 00000100:00100000:1.0:1789123098.648936:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381219584 00000100:00080000:2.0:1789123098.648977:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789123098.648977:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789123098.648984:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876031381219584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123098.649023:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876031381219584:12345-0@lo:400:kworker.0 Request processed in 40us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123098.649029:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789123098.650386:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435519680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381219072:0@lo:400:kworker.0 00000100:00100000:3.0:1789123098.650404:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435518f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876031381219584:0@lo:400:kworker.0 00000100:00100000:0.0:1789123098.654199:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123098.654262:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3301f52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381219840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789123098.654302:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123098.654932:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381219840 00000100:00100000:1.0:1789123098.654941:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381219840 00000100:00100000:1.0:1789123098.655117:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789123098.655129:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f52940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381219840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789123098.655170:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123098.655333:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381219328 00000100:00100000:2.0:1789123098.655338:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381219328 00000100:00100000:2.0:1789123098.655379:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789123098.655386:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381219328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123098.660035:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f52940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381219840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4899us (5722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123098.660050:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789123098.663643:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381219328:12345-0@lo:400:kworker.0 Request processed in 8237us (9431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123098.663658:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1789123098.663708:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789123098.664085:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3301f52580 x1876031381219840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123114 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123098.664109:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3301f52580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381219840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789123098.664141:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435519e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381219328:0@lo:400:kworker.0 00010000:00010000:1.0:1789123099.140919:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123100.168960:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789123100.168982:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3301f51680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381219968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789123100.169049:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123100.169111:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381219968 00000100:00100000:0.0:1789123100.169118:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381219968 00000100:00100000:0.0:1789123100.169172:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789123100.169182:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f50b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381219968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789123100.169218:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789123100.169263:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f50b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381219968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123100.169270:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1789123100.169291:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789123100.169317:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3301f51680 x1876031381219968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123100.169336:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3301f51680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381219968:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789123100.170059:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789123100.498261:0:10122:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 06:38:18 (1789123098) === 00000100:00100000:1.0:1789123101.082420:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123101.082471:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123101.082716:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364408448 00000100:00100000:2.0:1789123101.082726:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364408448 00000100:00100000:2.0:1789123101.082808:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 62 00000100:00100000:2.0:1789123101.082820:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2352:x1876031364408448:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1789123101.082913:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2352:x1876031364408448:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 95us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123101.082920:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 62 00000100:00080000:0.0:1789123101.083332:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789123101.083427:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364408320 00000100:00100000:3.0:1789123101.083432:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364408320 00000100:00100000:3.0:1789123101.083468:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 206 00000100:00100000:3.0:1789123101.083475:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+10:2352:x1876031364408320:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1789123101.083519:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+10:2352:x1876031364408320:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 45us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123101.083526:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 206 00000100:00100000:1.0:1789123101.157723:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123101.157905:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364408576 00000100:00100000:3.0:1789123101.157914:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364408576 00000100:00100000:3.0:1789123101.157969:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 207 00000100:00100000:3.0:1789123101.157980:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+10:8136:x1876031364408576:12345-192.168.206.30@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789123101.157996:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123101.158013:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f34029f2000/0x7e1648d68fc91b97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f493 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123101.158041:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f34029f2000/0x7e1648d68fc91b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f493 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123101.158053:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f34029f2000/0x7e1648d68fc91b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f493 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123101.158062:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f34029f2000, rc 0) 00000100:00100000:3.0:1789123101.158120:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+11:8136:x1876031364408576:12345-192.168.206.30@tcp:101:mount.lustre.0 Request processed in 143us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123101.158127:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 207 00000100:00100000:0.0:1789123101.174775:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123101.174882:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364408704 00000100:00100000:2.0:1789123101.174892:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364408704 00000100:00100000:2.0:1789123101.174944:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 208 00000100:00100000:2.0:1789123101.174954:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+11:8136:x1876031364408704:12345-192.168.206.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789123101.175290:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+11:8136:x1876031364408704:12345-192.168.206.30@tcp:501:mount.lustre.0 Request processed in 336us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123101.175306:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 208 00010000:00010000:1.0:1789123101.189101:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123101.191338:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123101.191425:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364408832 00000100:00100000:1.0:1789123101.191434:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364408832 00000100:00100000:1.0:1789123101.191481:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 209 00000100:00100000:1.0:1789123101.191490:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+11:8136:x1876031364408832:12345-192.168.206.30@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789123101.191718:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+11:8136:x1876031364408832:12345-192.168.206.30@tcp:503:mount.lustre.0 Request processed in 228us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123101.191725:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 209 00000100:00100000:1.0:1789123101.200040:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123101.200158:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364408960 00000100:00100000:3.0:1789123101.200178:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364408960 00000100:00100000:3.0:1789123101.200231:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 210 00000100:00100000:3.0:1789123101.200241:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+11:8139:x1876031364408960:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789123101.200520:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+11:8139:x1876031364408960:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 279us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123101.200528:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 210 00000100:00100000:0.0:1789123101.238303:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123101.238436:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364409088 00000100:00100000:2.0:1789123101.238445:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364409088 00000100:00100000:2.0:1789123101.238502:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 211 00000100:00100000:2.0:1789123101.238511:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+11:8139:x1876031364409088:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789123101.238806:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+11:8139:x1876031364409088:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 294us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123101.238814:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 211 00000100:00100000:2.0:1789123101.258618:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123101.260039:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364409216 00000100:00100000:1.0:1789123101.260052:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364409216 00000100:00100000:1.0:1789123101.260111:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 212 00000100:00100000:1.0:1789123101.260121:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+11:8136:x1876031364409216:12345-192.168.206.30@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789123101.260136:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123101.260152:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f343bd32000/0x7e1648d68fc91b9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f4bd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123101.260180:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f343bd32000/0x7e1648d68fc91b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4bd expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123101.260191:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f343bd32000/0x7e1648d68fc91b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4bd expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123101.260211:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd32000, rc 0) 00000100:00100000:1.0:1789123101.260267:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+12:8136:x1876031364409216:12345-192.168.206.30@tcp:101:mount.lustre.0 Request processed in 148us (1660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123101.260288:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 212 00000100:00100000:0.0:1789123101.289468:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123101.289760:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364409344 00000100:00100000:1.0:1789123101.289770:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364409344 00000100:00100000:1.0:1789123101.289825:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 213 00000100:00100000:1.0:1789123101.289836:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+12:8136:x1876031364409344:12345-192.168.206.30@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789123101.289871:0:5834:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789123101.289895:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789123101.289898:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789123101.289901:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789123101.289903:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1789123101.295083:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+12:8136:x1876031364409344:12345-192.168.206.30@tcp:256:mount.lustre.0 Request processed in 5239us (5616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123101.295099:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 213 00000100:00100000:2.0:1789123101.299291:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123101.299714:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364409472 00000100:00100000:3.0:1789123101.299724:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364409472 00000100:00100000:3.0:1789123101.299783:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 214 00000100:00100000:3.0:1789123101.299802:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+12:8136:x1876031364409472:12345-192.168.206.30@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789123101.299818:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123101.299835:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f34029f3200/0x7e1648d68fc91ba5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f4c4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123101.299874:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f34029f3200/0x7e1648d68fc91ba5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4c4 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123101.299886:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f34029f3200/0x7e1648d68fc91ba5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4c4 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123101.299895:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f34029f3200, rc 0) 00000100:00100000:3.0:1789123101.299953:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+13:8136:x1876031364409472:12345-192.168.206.30@tcp:101:mount.lustre.0 Request processed in 153us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123101.299960:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 214 00000100:00100000:0.0:1789123101.308073:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123101.308158:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364409600 00000100:00100000:1.0:1789123101.308174:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364409600 00000100:00100000:1.0:1789123101.308222:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 215 00000100:00100000:1.0:1789123101.308232:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+13:8136:x1876031364409600:12345-192.168.206.30@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789123101.308491:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+13:8136:x1876031364409600:12345-192.168.206.30@tcp:501:mount.lustre.0 Request processed in 260us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123101.308499:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 215 00000100:00100000:0.0:1789123101.313417:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123101.313664:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364409728 00000100:00100000:1.0:1789123101.313672:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364409728 00000100:00100000:1.0:1789123101.313726:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 216 00000100:00100000:1.0:1789123101.313736:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+13:8136:x1876031364409728:12345-192.168.206.30@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789123101.313972:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+13:8136:x1876031364409728:12345-192.168.206.30@tcp:503:mount.lustre.0 Request processed in 237us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123101.313986:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 216 00000100:00100000:2.0:1789123101.324397:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123101.324485:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364409856 00000100:00100000:3.0:1789123101.324495:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364409856 00000100:00100000:3.0:1789123101.324555:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 217 00000100:00100000:3.0:1789123101.324565:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+13:8144:x1876031364409856:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789123101.324870:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+13:8144:x1876031364409856:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 305us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123101.324878:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 217 00000100:00100000:0.0:1789123101.334213:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123101.334547:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364409984 00000100:00100000:3.0:1789123101.334557:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364409984 00000100:00100000:3.0:1789123101.334619:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 218 00000100:00100000:3.0:1789123101.334654:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+13:8144:x1876031364409984:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789123101.334941:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+13:8144:x1876031364409984:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 313us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123101.334949:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 218 00000100:00100000:2.0:1789123101.345610:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123101.345950:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364410112 00000100:00100000:0.0:1789123101.345961:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364410112 00000100:00100000:0.0:1789123101.346008:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 10 00000100:00100000:0.0:1789123101.346016:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2351:x1876031364410112:12345-192.168.206.30@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789123101.346047:0:5840:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 949e01ae-fd37-4d7e-878c-bf5e18b249e6@192.168.206.30@tcp t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:0.0:1789123101.346096:0:5840:0:(genops.c:1385:class_connect()) connect: client 949e01ae-fd37-4d7e-878c-bf5e18b249e6, cookie 0x7e1648d68fc91bac 00000004:00100000:0.0:1789123101.346128:0:5840:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789123101.346556:0:5840:0:(import.c:65:import_set_state_nolock()) ffff9f33012b0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789123101.346714:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:949e01ae-fd37-4d7e-878c-bf5e18b249e6+6:2351:x1876031364410112:12345-192.168.206.30@tcp:38:mount.lustre.0 Request processed in 697us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123101.346723:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 10 00000100:00100000:0.0:1789123101.361679:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123101.361720:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123101.361798:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364410368 00000100:00100000:2.0:1789123101.361807:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364410368 00000100:00100000:2.0:1789123101.361892:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364410240 00000100:00100000:2.0:1789123101.361896:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364410240 00000100:00100000:2.0:1789123101.361917:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 11 00000100:00100000:2.0:1789123101.361926:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f51680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:949e01ae-fd37-4d7e-878c-bf5e18b249e6+7:8136:x1876031364410368:12345-192.168.206.30@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789123101.361968:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789123101.362052:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f51680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:949e01ae-fd37-4d7e-878c-bf5e18b249e6+7:8136:x1876031364410368:12345-192.168.206.30@tcp:41:mount.lustre.0 Request processed in 126us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123101.362060:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 11 00000100:00100000:2.0:1789123101.362091:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 12 00000100:00100000:2.0:1789123101.362098:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:949e01ae-fd37-4d7e-878c-bf5e18b249e6+6:0:x1876031364410240:12345-192.168.206.30@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789123101.362126:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789123101.362151:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:949e01ae-fd37-4d7e-878c-bf5e18b249e6+6:0:x1876031364410240:12345-192.168.206.30@tcp:41:mount.lustre.0 Request processed in 52us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123101.362157:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 12 00000100:00080000:0.0:1789123101.363419:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789123101.365519:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123101.365665:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364410496 00000100:00100000:3.0:1789123101.365675:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364410496 00000100:00100000:3.0:1789123101.365734:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 13 00000100:00100000:3.0:1789123101.365744:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:949e01ae-fd37-4d7e-878c-bf5e18b249e6+6:8136:x1876031364410496:12345-192.168.206.30@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789123101.365838:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:949e01ae-fd37-4d7e-878c-bf5e18b249e6+6:8136:x1876031364410496:12345-192.168.206.30@tcp:40:mount.lustre.0 Request processed in 96us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123101.365846:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 13 00000100:00100000:3.0:1789123101.368775:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123101.368817:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123101.368860:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123101.368951:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364410880 00000100:00100000:2.0:1789123101.368961:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364410880 00000100:00100000:2.0:1789123101.369010:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 1 00000100:00100000:2.0:1789123101.369019:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:949e01ae-fd37-4d7e-878c-bf5e18b249e6+6:8136:x1876031364410880:12345-192.168.206.30@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789123101.369266:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1789123101.369407:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:949e01ae-fd37-4d7e-878c-bf5e18b249e6+6:8136:x1876031364410880:12345-192.168.206.30@tcp:33:mount.lustre.0 Request processed in 389us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123101.369415:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 1 00000100:00100000:1.0:1789123101.379284:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364410624 00000100:00100000:1.0:1789123101.379301:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364410624 00000100:00100000:1.0:1789123101.379341:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364410752 00000100:00100000:1.0:1789123101.379345:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364410752 00000100:00100000:1.0:1789123101.379381:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 12 00000100:00100000:1.0:1789123101.379389:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1876031364410624:12345-192.168.206.30@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789123101.379419:0:8519:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 949e01ae-fd37-4d7e-878c-bf5e18b249e6@192.168.206.30@tcp t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:1.0:1789123101.379450:0:8519:0:(genops.c:1385:class_connect()) connect: client 949e01ae-fd37-4d7e-878c-bf5e18b249e6, cookie 0x7e1648d68fc91bb3 00002000:00100000:1.0:1789123101.379462:0:8519:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 949e01ae-fd37-4d7e-878c-bf5e18b249e6/ffff9f3407dcf000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789123101.379473:0:8519:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789123101.379715:0:8519:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1789123101.379875:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 13 00000100:00100000:3.0:1789123101.379882:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1876031364410752:12345-192.168.206.30@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789123101.379899:0:6686:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 949e01ae-fd37-4d7e-878c-bf5e18b249e6@192.168.206.30@tcp t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:3.0:1789123101.379919:0:6686:0:(genops.c:1385:class_connect()) connect: client 949e01ae-fd37-4d7e-878c-bf5e18b249e6, cookie 0x7e1648d68fc91bba 00002000:00100000:3.0:1789123101.379938:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 949e01ae-fd37-4d7e-878c-bf5e18b249e6/ffff9f34355a4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789123101.379955:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789123101.380158:0:6686:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789123101.380178:0:6686:0:(import.c:65:import_set_state_nolock()) ffff9f34355a3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789123101.380257:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:949e01ae-fd37-4d7e-878c-bf5e18b249e6+6:2351:x1876031364410752:12345-192.168.206.30@tcp:8:mount.lustre.0 Request processed in 373us (11404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123101.380265:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 13 00000100:00080000:1.0:1789123101.380620:0:8519:0:(import.c:65:import_set_state_nolock()) ffff9f3407dcd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789123101.380694:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:949e01ae-fd37-4d7e-878c-bf5e18b249e6+6:2351:x1876031364410624:12345-192.168.206.30@tcp:8:mount.lustre.0 Request processed in 1303us (11875us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123101.380701:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 12 00010000:00010000:1.0:1789123102.213085:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789123102.833414:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 949e01ae-fd37-4d7e-878c-bf5e18b249e6 00010000:00010000:1.0:1789123103.238816:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123103.749217:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3301f53c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381220096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789123103.749283:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123103.749931:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381220096 00000100:00100000:0.0:1789123103.749940:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381220096 00000100:00100000:0.0:1789123103.749997:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789123103.750007:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381220096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789123103.750039:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789123103.750089:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381220096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123103.750097:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1789123103.750119:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3301f53c00 x1876031381220096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123119 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789123103.750119:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789123103.750141:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3301f53c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381220096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789123103.752954:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f340665da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd41f4a0-f4e3-41a1-856e-0c34af912023:3303:1876031381220224:0@lo:400:kworker.0 00000100:00100000:3.0:1789123103.752966:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f340665e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876031381220352:0@lo:400:kworker.0 00000100:00100000:3.0:1789123103.753333:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123103.753386:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789123103.753392:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f340665c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381220480:0@lo:400:kworker.0 00000100:00100000:3.0:1789123103.753415:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123103.753442:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f340665c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381220608:0@lo:400:kworker.0 00000100:00100000:3.0:1789123103.753464:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123103.753493:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381220608 00000100:00100000:3.0:1789123103.753498:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381220608 00000100:00100000:3.0:1789123103.753549:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789123103.753558:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381220608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123103.753618:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381220608:12345-0@lo:400:kworker.0 Request processed in 62us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123103.753654:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1789123103.753688:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f340665c3c0 x1876031381220608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123103.753713:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f340665c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381220608:0@lo:400:kworker.0 00000100:00100000:1.0:1789123103.756964:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123103.757145:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f340665cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876031381220736:0@lo:400:kworker.0 00000100:00100000:1.0:1789123103.757200:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123103.757254:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381220352 00000100:00100000:1.0:1789123103.757261:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381220352 00000100:00100000:1.0:1789123103.757315:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381220480 00000100:00100000:1.0:1789123103.757318:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381220480 00000100:00100000:1.0:1789123103.757333:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381220736 00000100:00100000:1.0:1789123103.757335:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381220736 00000100:00100000:2.0:1789123103.757650:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789123103.757663:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876031381220352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123103.757721:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876031381220352:12345-0@lo:400:kworker.0 Request processed in 62us (4388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123103.757740:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789123103.757759:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789123103.757765:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381220480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123103.757790:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381220480:12345-0@lo:400:kworker.0 Request processed in 26us (4374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123103.757802:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789123103.757813:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789123103.757819:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f341848b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876031381220736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123103.757859:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f341848b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876031381220736:12345-0@lo:400:kworker.0 Request processed in 40us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123103.757865:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789123103.757900:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f340665c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381220480:0@lo:400:kworker.0 00000100:00100000:2.0:1789123103.757911:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f340665e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876031381220352:0@lo:400:kworker.0 00000100:00100000:2.0:1789123103.758259:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381220224 00000100:00100000:2.0:1789123103.758264:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381220224 00000100:00100000:1.0:1789123103.758295:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f340665cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876031381220736:0@lo:400:kworker.0 00000100:00100000:2.0:1789123103.758300:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789123103.758310:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3303:x1876031381220224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123103.758359:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3303:x1876031381220224:12345-0@lo:400:kworker.0 Request processed in 50us (1403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123103.758364:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789123103.758452:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f340665da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd41f4a0-f4e3-41a1-856e-0c34af912023:3303:1876031381220224:0@lo:400:kworker.0 00000100:00080000:1.0:1789123103.758818:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789123103.758824:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789123104.262162:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123105.285376:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3301f51a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381220864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789123105.285453:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123105.286083:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381220864 00000100:00100000:0.0:1789123105.286092:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381220864 00010000:00010000:3.0:1789123105.290317:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123105.298669:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789123105.298684:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343551a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381220864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789123105.298721:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789123105.298858:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343551a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381220864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 178us (13404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123105.298866:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1789123105.298912:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789123105.299383:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3301f51a40 x1876031381220864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123121 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123105.299403:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3301f51a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381220864:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1789123105.338395:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 949e01ae-fd37-4d7e-878c-bf5e18b249e6 00000001:00100000:1.0:1789123105.844799:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 949e01ae-fd37-4d7e-878c-bf5e18b249e6 00010000:00010000:1.0:1789123106.309330:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123106.715593:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123106.715852:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123106.715934:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123106.715981:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364411008 00000100:00100000:0.0:1789123106.715989:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364411008 00000100:00100000:0.0:1789123106.716047:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 220 00000100:00100000:0.0:1789123106.716057:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+13:2353:x1876031364411008:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123106.716120:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+13:2353:x1876031364411008:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 65us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123106.716128:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 220 00000100:00100000:3.0:1789123106.716988:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123106.717124:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123106.717150:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364411520 00000100:00100000:3.0:1789123106.717156:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364411520 00000100:00100000:3.0:1789123106.717198:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364411392 00000100:00100000:3.0:1789123106.717201:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364411392 00000100:00100000:3.0:1789123106.717222:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 33 00000100:00100000:3.0:1789123106.717229:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2353:x1876031364411520:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1789123106.717276:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2353:x1876031364411520:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 47us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123106.717283:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 33 00000100:00100000:3.0:1789123106.717295:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 34 00000100:00100000:3.0:1789123106.717301:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2352:x1876031364411392:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1789123106.717323:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2352:x1876031364411392:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 22us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123106.717329:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 34 00000100:00080000:3.0:1789123106.717344:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789123106.717348:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789123106.717479:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364411136 00000100:00100000:1.0:1789123106.717485:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364411136 00000100:00100000:0.0:1789123106.717598:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364411264 00000100:00100000:0.0:1789123106.717602:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364411264 00000100:00100000:0.0:1789123106.717657:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 66 00000100:00100000:0.0:1789123106.717665:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2352:x1876031364411136:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123106.717770:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2352:x1876031364411136:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 38us (1850us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123106.717777:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 66 00000100:00100000:0.0:1789123106.717790:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 67 00000100:00100000:0.0:1789123106.717797:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2353:x1876031364411264:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123106.717832:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2353:x1876031364411264:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 26us (1889us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123106.717852:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 67 00000100:00080000:3.0:1789123106.722246:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1789123107.040118:0:10318:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1789123107.333057:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123108.356866:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123108.869444:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789123108.869784:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3301f53c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381220992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789123108.869868:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123108.869994:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381220992 00000100:00100000:0.0:1789123108.870001:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381220992 00000100:00100000:0.0:1789123108.870063:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789123108.870358:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3418489680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381220992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789123108.870393:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789123108.870442:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3418489680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381220992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123108.870449:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1789123108.870553:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789123108.870838:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3301f53c00 x1876031381220992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123124 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123108.870858:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3301f53c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381220992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789123108.874108:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3418489a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381221504:0@lo:400:kworker.0 00000100:00100000:1.0:1789123108.874192:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123108.874234:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789123108.874242:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f341848bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876031381221376:0@lo:400:kworker.0 00000100:00100000:1.0:1789123108.874276:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123108.874309:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381221504 00000100:00100000:1.0:1789123108.874324:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381221504 00000100:00100000:1.0:1789123108.874378:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789123108.874387:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381221504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123108.874436:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381221504:12345-0@lo:400:kworker.0 Request processed in 50us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123108.874444:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789123108.874465:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381221376 00000100:00100000:1.0:1789123108.874468:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381221376 00000100:00100000:1.0:1789123108.874494:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789123108.874514:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876031381221376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123108.874545:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876031381221376:12345-0@lo:400:kworker.0 Request processed in 44us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123108.874551:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789123108.874592:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f341848bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876031381221376:0@lo:400:kworker.0 00010000:00080000:1.0:1789123108.874605:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3418489a40 x1876031381221504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123108.874615:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3418489a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381221504:0@lo:400:kworker.0 00000100:00100000:3.0:1789123108.874832:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3418488780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381221120:0@lo:400:kworker.0 00000100:00100000:3.0:1789123108.874868:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123108.874909:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34063b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876031381221632:0@lo:400:kworker.0 00000100:00100000:3.0:1789123108.874933:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123108.874950:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789123108.874955:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f341848b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381221248:0@lo:400:kworker.0 00000100:00100000:3.0:1789123108.874978:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123108.875005:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381221632 00000100:00100000:3.0:1789123108.875009:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381221632 00000100:00100000:3.0:1789123108.875032:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381221248 00000100:00100000:3.0:1789123108.875035:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381221248 00000100:00100000:3.0:1789123108.875048:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789123108.875055:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876031381221632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123108.875090:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876031381221632:12345-0@lo:400:kworker.0 Request processed in 36us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123108.875097:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789123108.875110:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789123108.875117:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381221248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123108.875144:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381221248:12345-0@lo:400:kworker.0 Request processed in 29us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123108.875151:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789123108.875176:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f341848b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381221248:0@lo:400:kworker.0 00000100:00100000:3.0:1789123108.875186:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34063b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876031381221632:0@lo:400:kworker.0 00000100:00080000:2.0:1789123108.875271:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789123108.875277:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789123108.875345:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381221120 00000100:00100000:1.0:1789123108.875349:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381221120 00000100:00100000:1.0:1789123108.875429:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789123108.875437:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3302:x1876031381221120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123108.875483:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3302:x1876031381221120:12345-0@lo:400:kworker.0 Request processed in 48us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123108.875491:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789123108.875562:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3418488780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381221120:0@lo:400:kworker.0 00010000:00010000:3.0:1789123109.383902:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123110.405016:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789123110.405038:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3301f53c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381221760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789123110.405106:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123110.405171:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381221760 00000100:00100000:0.0:1789123110.405178:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381221760 00000100:00100000:0.0:1789123110.405238:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789123110.405250:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f51a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381221760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789123110.405282:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789123110.405329:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f51a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381221760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123110.405337:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1789123110.405381:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789123110.405421:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3301f53c00 x1876031381221760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123126 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123110.405438:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3301f53c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381221760:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789123110.405677:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123111.429200:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123111.838565:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123111.838668:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123111.838710:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123111.838735:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123111.838785:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123111.838838:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364411648 00000100:00100000:2.0:1789123111.838868:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364412032 00000100:00100000:2.0:1789123111.838875:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364412032 00000100:00100000:2.0:1789123111.838984:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364412160 00000100:00100000:2.0:1789123111.838988:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364412160 00000100:00100000:3.0:1789123111.839020:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364411776 00000100:00100000:2.0:1789123111.839023:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 36 00000100:00100000:3.0:1789123111.839027:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364411776 00000100:00100000:2.0:1789123111.839038:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2355:x1876031364412032:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1789123111.839072:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364411904 00000100:00100000:3.0:1789123111.839076:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364411904 00000100:00100000:3.0:1789123111.839102:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 71 00000100:00100000:3.0:1789123111.839111:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f53c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2355:x1876031364411776:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1789123111.839169:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f53c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2355:x1876031364411776:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 59us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123111.839177:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 71 00000100:00100000:3.0:1789123111.839196:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 72 00000100:00100000:3.0:1789123111.839203:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2355:x1876031364411904:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1789123111.839228:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2355:x1876031364411904:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 26us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123111.839234:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 72 00000100:00100000:0.0:1789123111.839663:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364411648 00000100:00100000:0.0:1789123111.839710:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 222 00000100:00100000:0.0:1789123111.839717:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+13:2355:x1876031364411648:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123111.839750:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+13:2355:x1876031364411648:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 35us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123111.839757:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 222 00000100:00100000:0.0:1789123111.839805:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 37 00000100:00100000:0.0:1789123111.839815:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d55680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2355:x1876031364412160:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123111.839844:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d55680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2355:x1876031364412160:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 32us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123111.839990:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 37 00000100:00100000:2.0:1789123111.840012:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2355:x1876031364412032:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 117us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123111.840026:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 36 00000100:00080000:0.0:1789123111.851987:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789123111.852002:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789123111.852006:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789123112.453698:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123113.479232:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123113.988993:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34063b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381221888:0@lo:400:kworker.0 00000100:00100000:1.0:1789123113.989103:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123113.989164:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34063b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876031381222400:0@lo:400:kworker.0 00000100:00100000:1.0:1789123113.989192:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123113.989225:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789123113.989230:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34063b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876031381222016:0@lo:400:kworker.0 00000100:00100000:1.0:1789123113.989266:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123113.989287:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34063b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381222528:0@lo:400:kworker.0 00000100:00100000:1.0:1789123113.989314:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123113.989347:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34063b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381222144:0@lo:400:kworker.0 00000100:00100000:1.0:1789123113.989371:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123113.989391:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789123113.989396:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34063b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381222272:0@lo:400:kworker.0 00000100:00100000:1.0:1789123113.989417:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123113.989449:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381221888 00000100:00100000:1.0:1789123113.989457:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381221888 00000100:00100000:1.0:1789123113.989507:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789123113.989517:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3304:x1876031381221888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123113.989575:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3304:x1876031381221888:12345-0@lo:400:kworker.0 Request processed in 58us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123113.989584:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789123113.989652:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381222400 00000100:00100000:1.0:1789123113.989657:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381222400 00000100:00100000:1.0:1789123113.989696:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381222016 00000100:00100000:1.0:1789123113.989699:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381222016 00000100:00100000:1.0:1789123113.989710:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381222144 00000100:00100000:1.0:1789123113.989712:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381222144 00000100:00100000:1.0:1789123113.989741:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789123113.989747:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876031381222400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123113.989794:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876031381222400:12345-0@lo:400:kworker.0 Request processed in 36us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123113.989801:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789123113.989815:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789123113.989821:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876031381222016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123113.989850:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876031381222016:12345-0@lo:400:kworker.0 Request processed in 30us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123113.989856:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789123113.989868:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789123113.989874:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381222144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123113.989906:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381222144:12345-0@lo:400:kworker.0 Request processed in 32us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123113.989912:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789123113.989935:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381222528 00000100:00100000:1.0:1789123113.989938:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381222528 00000100:00100000:1.0:1789123113.989968:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381222272 00000100:00100000:1.0:1789123113.989971:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381222272 00000100:00100000:1.0:1789123113.989989:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789123113.989995:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381222528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123113.990029:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381222528:12345-0@lo:400:kworker.0 Request processed in 33us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123113.990035:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789123113.990046:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789123113.990052:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381222272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123113.990091:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381222272:12345-0@lo:400:kworker.0 Request processed in 39us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123113.990097:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1789123113.990125:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789123113.990129:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789123113.990133:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789123113.990171:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34063b4b40 x1876031381222272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123113.990189:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34063b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381222272:0@lo:400:kworker.0 00000100:00100000:1.0:1789123113.990204:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34063b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381222144:0@lo:400:kworker.0 00000100:00100000:1.0:1789123113.990242:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34063b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876031381222016:0@lo:400:kworker.0 00010000:00080000:1.0:1789123113.990252:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34063b43c0 x1876031381222528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123113.990262:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34063b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381222528:0@lo:400:kworker.0 00000100:00100000:1.0:1789123113.990271:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34063b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381221888:0@lo:400:kworker.0 00000100:00100000:1.0:1789123113.990280:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34063b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876031381222400:0@lo:400:kworker.0 00000100:00100000:2.0:1789123113.990442:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789123113.990455:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435518780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381222656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789123113.990491:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123113.990526:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381222656 00000100:00100000:2.0:1789123113.990531:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381222656 00000100:00100000:2.0:1789123113.990565:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789123113.990572:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343551b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381222656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789123113.990608:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123113.990673:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343551b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381222656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123113.990681:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1789123113.990713:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3435518780 x1876031381222656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123129 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123113.990729:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435518780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381222656:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789123114.505654:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123115.525002:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789123115.525021:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34063b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381222784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789123115.525254:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123115.525359:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381222784 00000100:00100000:2.0:1789123115.525366:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381222784 00000100:00100000:2.0:1789123115.525428:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789123115.525438:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381222784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789123115.525479:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123115.525523:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381222784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123115.525531:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1789123115.526232:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789123115.526278:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789123115.526313:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34063b5680 x1876031381222784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123131 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123115.526333:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34063b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381222784:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789123116.557216:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123116.964465:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123116.964507:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123116.964546:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123116.964572:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123116.964598:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123116.964623:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364412544 00000100:00100000:1.0:1789123116.964656:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364412544 00000100:00100000:1.0:1789123116.964721:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364412416 00000100:00100000:1.0:1789123116.964724:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364412416 00000100:00100000:1.0:1789123116.964747:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 76 00000100:00100000:1.0:1789123116.964755:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2355:x1876031364412544:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123116.964838:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2355:x1876031364412544:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 83us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123116.964846:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 76 00000100:00100000:1.0:1789123116.964865:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 77 00000100:00100000:1.0:1789123116.964872:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2355:x1876031364412416:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123116.964898:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2355:x1876031364412416:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 27us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123116.964904:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 77 00000100:00100000:1.0:1789123116.964923:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364412800 00000100:00100000:1.0:1789123116.964927:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364412800 00000100:00100000:1.0:1789123116.964953:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364412672 00000100:00100000:1.0:1789123116.964957:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364412672 00000100:00100000:1.0:1789123116.964978:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 40 00000100:00100000:1.0:1789123116.964985:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2355:x1876031364412800:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123116.965030:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2355:x1876031364412800:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 46us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123116.965037:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 40 00000100:00100000:1.0:1789123116.965049:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 41 00000100:00100000:1.0:1789123116.965057:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2355:x1876031364412672:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123116.965079:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2355:x1876031364412672:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 24us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123116.965086:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 41 00000100:00080000:1.0:1789123116.965102:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789123116.965106:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789123116.965108:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789123116.966433:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364412288 00000100:00100000:3.0:1789123116.966444:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364412288 00000100:00100000:3.0:1789123116.966495:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 224 00000100:00100000:3.0:1789123116.966504:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+13:2355:x1876031364412288:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1789123116.966562:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+13:2355:x1876031364412288:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 59us (2105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123116.966569:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 224 00010000:00010000:1.0:1789123117.581396:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123118.598797:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123119.108815:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789123119.108838:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435518780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381222912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789123119.108910:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123119.108982:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381223040:0@lo:400:kworker.0 00000100:00100000:0.0:1789123119.109002:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381223424:0@lo:400:kworker.0 00000100:00100000:2.0:1789123119.109016:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123119.109051:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123119.109053:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381223552:0@lo:400:kworker.0 00000100:00100000:2.0:1789123119.109087:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123119.109091:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381223168:0@lo:400:kworker.0 00000100:00100000:2.0:1789123119.109124:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876031381223296:0@lo:400:kworker.0 00000100:00100000:0.0:1789123119.109130:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123119.109162:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123119.109176:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381223424 00000100:00100000:0.0:1789123119.109186:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381223424 00000100:00100000:2.0:1789123119.109202:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381223040 00000100:00100000:2.0:1789123119.109208:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381223040 00000100:00100000:2.0:1789123119.109257:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789123119.109261:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789123119.109269:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3305:x1876031381223040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123119.109289:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c23a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381223424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123119.109322:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3305:x1876031381223040:12345-0@lo:400:kworker.0 Request processed in 55us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123119.109330:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789123119.109362:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381223552 00000100:00100000:2.0:1789123119.109365:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381223552 00000100:00100000:2.0:1789123119.109389:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381223168 00000100:00100000:2.0:1789123119.109392:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381223168 00000100:00100000:2.0:1789123119.109414:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381223296 00000100:00100000:2.0:1789123119.109418:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381223296 00000100:00100000:2.0:1789123119.109433:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789123119.109438:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435518f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876031381223552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123119.109471:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435518f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876031381223552:12345-0@lo:400:kworker.0 Request processed in 32us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123119.109477:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789123119.109489:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789123119.109496:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381223168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123119.109526:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381223168:12345-0@lo:400:kworker.0 Request processed in 32us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123119.109532:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789123119.109544:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789123119.109550:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435519680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876031381223296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123119.109579:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435519680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876031381223296:12345-0@lo:400:kworker.0 Request processed in 29us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123119.109585:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789123119.109645:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876031381223296:0@lo:400:kworker.0 00000100:00100000:2.0:1789123119.109675:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381223168:0@lo:400:kworker.0 00000100:00100000:2.0:1789123119.109697:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381223552:0@lo:400:kworker.0 00000100:00100000:2.0:1789123119.109705:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381223040:0@lo:400:kworker.0 00000100:00100000:0.0:1789123119.110461:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c23a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381223424:12345-0@lo:400:kworker.0 Request processed in 1175us (1410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123119.110470:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1789123119.110648:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789123119.110654:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789123119.111002:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34365ccf00 x1876031381223424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123119.111016:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381223424:0@lo:400:kworker.0 00000100:00100000:1.0:1789123119.112409:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381222912 00000100:00100000:1.0:1789123119.112420:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381222912 00000100:00100000:1.0:1789123119.112475:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789123119.112483:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435519e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381222912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789123119.112518:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789123119.112541:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789123119.112595:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435519e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381222912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (3686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123119.112602:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1789123119.112670:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3435518780 x1876031381222912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123119.112688:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435518780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381222912:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789123119.621956:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123120.644832:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123120.645045:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789123120.645065:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381223680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789123120.645133:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123120.645430:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381223680 00000100:00100000:0.0:1789123120.645438:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381223680 00000100:00100000:0.0:1789123120.645491:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789123120.645501:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381223680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789123120.645534:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789123120.645596:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381223680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123120.645604:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1789123120.645740:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34365cc000 x1876031381223680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123136 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123120.645847:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381223680:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789123121.668804:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123122.092792:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123122.092841:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123122.092879:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123122.092907:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123122.092943:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364413184 00000100:00100000:3.0:1789123122.092950:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364413184 00000100:00100000:3.0:1789123122.093003:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364413056 00000100:00100000:3.0:1789123122.093006:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364413056 00000100:00100000:3.0:1789123122.093028:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 81 00000100:00100000:3.0:1789123122.093038:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2352:x1876031364413184:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1789123122.093109:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2352:x1876031364413184:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 71us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123122.093116:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 81 00000100:00100000:3.0:1789123122.093133:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 82 00000100:00100000:3.0:1789123122.093140:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2352:x1876031364413056:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1789123122.093166:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2352:x1876031364413056:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 26us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123122.093172:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 82 00000100:00080000:3.0:1789123122.093190:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789123122.093771:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123122.094186:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364412928 00000100:00100000:0.0:1789123122.094193:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364412928 00000100:00100000:0.0:1789123122.094229:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 226 00000100:00100000:0.0:1789123122.094237:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+13:2352:x1876031364412928:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123122.094281:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+13:2352:x1876031364412928:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 45us (1499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123122.094287:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 226 00000100:00100000:0.0:1789123122.094318:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364413312 00000100:00100000:0.0:1789123122.094321:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364413312 00000100:00100000:0.0:1789123122.094348:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364413440 00000100:00100000:0.0:1789123122.094350:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364413440 00000100:00100000:0.0:1789123122.094370:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 14 00000100:00100000:0.0:1789123122.094376:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2351:x1876031364413312:12345-192.168.206.30@tcp:9:kworker.0 00000020:00000080:0.0:1789123122.094407:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc91bb3 00000100:00080000:0.0:1789123122.094416:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9f3407dcd000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789123122.094452:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789123122.094989:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:949e01ae-fd37-4d7e-878c-bf5e18b249e6+2:2351:x1876031364413312:12345-192.168.206.30@tcp:9:kworker.0 Request processed in 611us (2078us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123122.094996:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 14 00000100:00100000:0.0:1789123122.095011:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 15 00000100:00100000:0.0:1789123122.095017:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2351:x1876031364413440:12345-192.168.206.30@tcp:9:kworker.0 00000020:00000080:0.0:1789123122.095030:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc91bba 00000100:00080000:0.0:1789123122.095035:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9f34355a3800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789123122.095057:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789123122.095242:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:949e01ae-fd37-4d7e-878c-bf5e18b249e6+2:2351:x1876031364413440:12345-192.168.206.30@tcp:9:kworker.0 Request processed in 225us (1473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123122.095249:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 15 00010000:00010000:0.0:1789123122.095274:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789123122.095280:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789123122.095283:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789123122.100826:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123122.692831:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789123123.275747:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 949e01ae-fd37-4d7e-878c-bf5e18b249e6 00000020:00000080:2.0:1789123123.275757:0:6710:0:(genops.c:885:class_export_put()) final put ffff9f3407dcf000/949e01ae-fd37-4d7e-878c-bf5e18b249e6 00000020:00000080:3.0:1789123123.275808:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9f3407dcf000/949e01ae-fd37-4d7e-878c-bf5e18b249e6 for lustre-OST0000 00000020:00000080:3.0:1789123123.275860:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f3407dcd000 for lustre-OST0000 00000001:02000400:1.0:1789123123.567970:0:11020:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789123123.720474:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123124.234480:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343551b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381223808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789123124.234552:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123124.234661:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381223808 00000100:00100000:2.0:1789123124.234668:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381223808 00000100:00100000:2.0:1789123124.234725:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789123124.234755:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435518780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381223808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789123124.234789:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123124.234836:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435518780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381223808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123124.234843:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1789123124.234860:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789123124.234884:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f343551b480 x1876031381223808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123140 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123124.234900:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343551b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381223808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789123124.241162:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876031381224064:0@lo:400:kworker.0 00000100:00100000:2.0:1789123124.241240:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123124.241282:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789123124.241289:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343551b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381223936:0@lo:400:kworker.0 00000100:00100000:2.0:1789123124.241353:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123124.241379:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343551ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381224448:0@lo:400:kworker.0 00000100:00100000:2.0:1789123124.241403:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123124.241434:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381224064 00000100:00100000:2.0:1789123124.241442:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381224064 00000100:00100000:2.0:1789123124.241488:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381224448 00000100:00100000:2.0:1789123124.241492:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381224448 00000100:00100000:2.0:1789123124.241519:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789123124.241527:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876031381224064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123124.241573:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876031381224064:12345-0@lo:400:kworker.0 Request processed in 47us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123124.241580:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789123124.241594:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789123124.241599:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435519a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876031381224448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123124.241620:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435519a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876031381224448:12345-0@lo:400:kworker.0 Request processed in 21us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123124.241625:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789123124.241664:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381223936 00000100:00100000:2.0:1789123124.241667:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381223936 00000100:00100000:2.0:1789123124.241689:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789123124.241696:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3305:x1876031381223936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123124.241722:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3305:x1876031381223936:12345-0@lo:400:kworker.0 Request processed in 27us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123124.241740:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789123124.241775:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343551a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381224192:0@lo:400:kworker.0 00000100:00100000:2.0:1789123124.241796:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123124.241818:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789123124.241824:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343551bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381224320:0@lo:400:kworker.0 00000100:00100000:2.0:1789123124.241844:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123124.241866:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381224320 00000100:00100000:2.0:1789123124.241869:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381224320 00000100:00100000:2.0:1789123124.241895:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789123124.241900:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381224320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123124.241928:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381224320:12345-0@lo:400:kworker.0 Request processed in 28us (83us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123124.241934:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1789123124.241949:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789123124.241952:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789123124.241972:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f343551bc00 x1876031381224320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123124.241985:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343551bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381224320:0@lo:400:kworker.0 00000100:00100000:2.0:1789123124.242005:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381224192 00000100:00100000:2.0:1789123124.242007:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381224192 00000100:00100000:2.0:1789123124.242027:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789123124.242032:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381224192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123124.242057:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381224192:12345-0@lo:400:kworker.0 Request processed in 25us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123124.242063:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1789123124.242074:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789123124.242086:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343551a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381224192:0@lo:400:kworker.0 00000100:00100000:2.0:1789123124.242101:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343551b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381223936:0@lo:400:kworker.0 00000100:00100000:2.0:1789123124.242109:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343551ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381224448:0@lo:400:kworker.0 00000100:00100000:2.0:1789123124.242125:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876031381224064:0@lo:400:kworker.0 00010000:00010000:0.0:1789123124.742269:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123125.765039:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789123125.765063:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381224576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789123125.765145:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789123125.765298:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123125.765967:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381224576 00000100:00100000:0.0:1789123125.765978:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381224576 00000100:00100000:0.0:1789123125.766032:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789123125.766043:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381224576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789123125.766076:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789123125.766132:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381224576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123125.766140:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1789123125.766950:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34365cf0c0 x1876031381224576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123125.766971:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381224576:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1789123126.341062:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 949e01ae-fd37-4d7e-878c-bf5e18b249e6 00000020:00000080:0.0:1789123126.341072:0:7644:0:(genops.c:885:class_export_put()) final put ffff9f34355a4000/949e01ae-fd37-4d7e-878c-bf5e18b249e6 00000020:00000080:2.0:1789123126.341102:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9f34355a4000/949e01ae-fd37-4d7e-878c-bf5e18b249e6 for lustre-OST0001 00000020:00000080:2.0:1789123126.341209:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f34355a3800 for lustre-OST0001 00010000:00010000:0.0:1789123126.789302:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789123127.136830:0:11169:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe9fe4bdd0 20000000:00000080:1.0:1789123127.136850:0:11169:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f34048cf400 uarg=0000000000000000 20000000:01000000:1.0:1789123127.136886:0:11169:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789123127.136892:0:11169:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789123127.136896:0:11169:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789123127.141887:0:11170:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1789123127.151359:0:11169:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789123127.161537:0:11169:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789123127.162987:0:11169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91bc1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123127.163013:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f3435b52600/0x7e1648d68fc91b6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91b66 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123127.163033:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f3435b53000/0x7e1648d68fc91b7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91b74 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123127.163043:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f3401514e00/0x7e1648d68fc91b82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f48c expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123127.163051:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f342d80ac00/0x7e1648d68fc91b90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91b89 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123127.163058:0:11169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f34029f3200/0x7e1648d68fc91ba5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4c4 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123127.163065:0:11169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91bc1 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123127.163104:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f34029f3200/0x7e1648d68fc91ba5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4c4 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123127.163119:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f34029f3200/0x7e1648d68fc91ba5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4c4 expref: 12 pid: 5833 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123127.163133:0:11169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34354f2d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1876031381224704:192.168.206.30@tcp:104: 00010000:00010000:3.0:1789123127.163231:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f342d80ac00/0x7e1648d68fc91b90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc91b89 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123127.163239:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f342d80ac00/0x7e1648d68fc91b90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc91b89 expref: 18 pid: 5833 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123127.163249:0:11169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34354f03c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1876031381224832:0@lo:104: 00000100:00100000:3.0:1789123127.163298:0:11169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789123127.163390:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f3401514e00/0x7e1648d68fc91b82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f48c expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123127.163400:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f3401514e00/0x7e1648d68fc91b82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f48c expref: 12 pid: 5835 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123127.163422:0:11169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34354f0b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1876031381224960:192.168.206.30@tcp:104: 00010000:00010000:3.0:1789123127.163453:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f3435b53000/0x7e1648d68fc91b7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc91b74 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123127.163460:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f3435b53000/0x7e1648d68fc91b7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc91b74 expref: 18 pid: 5834 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123127.163467:0:11169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34354f1e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1876031381225088:0@lo:104: 00000100:00100000:3.0:1789123127.164147:0:11169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789123127.168402:0:11169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f3435b52600/0x7e1648d68fc91b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc91b66 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123127.168424:0:11169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f3435b52600/0x7e1648d68fc91b6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc91b66 expref: 18 pid: 5835 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123127.168439:0:11169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f340665ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1876031381225216:0@lo:104: 00000100:00100000:3.0:1789123127.168511:0:11169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123127.174264:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381224832 00000100:00100000:1.0:1789123127.174279:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381224832 00000100:00100000:1.0:1789123127.174338:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381225088 00000100:00100000:1.0:1789123127.174341:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381225088 00000100:00100000:1.0:1789123127.174360:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789123127.174369:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+4:11169:x1876031381224832:12345-0@lo:104: 00010000:00010000:1.0:1789123127.174388:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91b89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91b90 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123127.174500:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789123127.174507:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+4:11169:x1876031381224832:12345-0@lo:104: Request processed in 139us (11209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123127.174514:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789123127.174547:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789123127.174554:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:11169:x1876031381225088:12345-0@lo:104: 00010000:00010000:1.0:1789123127.174563:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f342d80b600/0x7e1648d68fc91b74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91b7b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123127.174602:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1789123127.174724:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789123127.174731:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91b89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91b90 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123127.174739:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32a00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1789123127.174743:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91b89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc91b90 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123127.174752:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91b89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc91b90 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789123127.174759:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91b89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc91b90 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123127.174764:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789123127.174808:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91b89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91b90 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123127.174815:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789123127.174845:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91b89 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91b90 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123127.174852:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91b89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91b90 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123127.174876:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789123127.174879:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f342d80b600/0x7e1648d68fc91b74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91b7b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123127.174885:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80b600 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1789123127.174888:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f342d80b600/0x7e1648d68fc91b74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc91b7b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123127.174894:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f342d80b600/0x7e1648d68fc91b74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc91b7b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789123127.174900:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f342d80b600/0x7e1648d68fc91b74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc91b7b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123127.174905:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789123127.174919:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f342d80b600/0x7e1648d68fc91b74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91b7b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123127.174925:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789123127.174931:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f342d80b600/0x7e1648d68fc91b74 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91b7b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123127.174938:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f342d80b600/0x7e1648d68fc91b74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91b7b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123127.174947:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123127.174949:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123127.174950:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123127.174966:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381225344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789123127.175008:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123127.175052:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789123127.175057:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381225472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789123127.175075:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123127.175331:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:11169:x1876031381225088:12345-0@lo:104: Request processed in 777us (11843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123127.175340:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1789123127.175362:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123127.175480:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381225344 00000100:00100000:2.0:1789123127.175486:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381225344 00010000:00010000:2.0:1789123127.175510:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f342d80ac00/0x7e1648d68fc91b90 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91b89 expref: 19 pid: 5833 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123127.175540:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381225472 00000100:00100000:2.0:1789123127.175542:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381225472 00010000:00010000:2.0:1789123127.175551:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f3435b53000/0x7e1648d68fc91b7b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91b74 expref: 20 pid: 5834 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123127.175563:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789123127.175568:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3406285c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+20:3302:x1876031381225344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789123127.175580:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123127.175584:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f342d80ac00/0x7e1648d68fc91b90 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91b89 expref: 20 pid: 5833 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123127.175594:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f342d80ac00/0x7e1648d68fc91b90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc91b89 expref: 20 pid: 5833 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123127.175621:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123127.175675:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3406285c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+20:3302:x1876031381225344:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123127.175681:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789123127.175726:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789123127.175733:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355183c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3302:x1876031381225472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789123127.175748:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123127.175753:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f3435b53000/0x7e1648d68fc91b7b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91b74 expref: 19 pid: 5834 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123127.175760:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f3435b53000/0x7e1648d68fc91b7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc91b74 expref: 19 pid: 5834 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123127.175770:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123127.175792:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355183c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3302:x1876031381225472:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123127.175798:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789123127.175827:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381225472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789123127.175835:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381225344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789123127.179829:0:11169:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f343567e540 going to sleep for 11 seconds 00010000:00010000:3.0:1789123127.179868:0:11169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f342d80ac00/0x7e1648d68fc91b90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc91b89 expref: 18 pid: 5833 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123127.179885:0:11169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34354f03c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1876031381224832:0@lo:104: 00010000:00010000:3.0:1789123127.179896:0:11169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3435b53000/0x7e1648d68fc91b7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc91b74 expref: 17 pid: 5834 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123127.179919:0:11169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34354f1e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1876031381225088:0@lo:104: 00000100:00100000:1.0:1789123127.180118:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123127.180194:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123127.180218:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364413568 00000100:00100000:1.0:1789123127.180224:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364413568 00010000:00010000:1.0:1789123127.180259:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f34029f3200/0x7e1648d68fc91ba5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4c4 expref: 13 pid: 5833 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123127.180284:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364413696 00000100:00100000:1.0:1789123127.180287:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364413696 00010000:00010000:1.0:1789123127.180297:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f3401514e00/0x7e1648d68fc91b82 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f48c expref: 14 pid: 5835 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123127.180310:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 27 00000100:00100000:1.0:1789123127.180317:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19924a15-1c73-4644-a9ca-864666412d45+14:2354:x1876031364413568:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789123127.180331:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123127.180336:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f34029f3200/0x7e1648d68fc91ba5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4c4 expref: 14 pid: 5833 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123127.180347:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f34029f3200/0x7e1648d68fc91ba5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4c4 expref: 14 pid: 5833 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123127.180375:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789123127.180424:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19924a15-1c73-4644-a9ca-864666412d45+14:2354:x1876031364413568:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 106us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123127.180432:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 27 00000100:00100000:1.0:1789123127.180450:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 28 00000100:00100000:1.0:1789123127.180456:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19924a15-1c73-4644-a9ca-864666412d45+13:2354:x1876031364413696:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789123127.180464:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123127.180469:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f3401514e00/0x7e1648d68fc91b82 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f48c expref: 13 pid: 5835 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123127.180478:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f3401514e00/0x7e1648d68fc91b82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f48c expref: 13 pid: 5835 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123127.180503:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789123127.180523:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19924a15-1c73-4644-a9ca-864666412d45+13:2354:x1876031364413696:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 66us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123127.180529:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 28 00000100:00100000:1.0:1789123127.180622:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381225216 00000100:00100000:1.0:1789123127.180650:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381225216 00000100:00100000:1.0:1789123127.180668:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789123127.180674:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:11169:x1876031381225216:12345-0@lo:104: 00010000:00010000:1.0:1789123127.180685:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f343bd33000/0x7e1648d68fc91b66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91b6d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123127.180734:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789123127.180739:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:11169:x1876031381225216:12345-0@lo:104: Request processed in 65us (12229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123127.180750:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1789123127.180765:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789123127.180770:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f343bd33000/0x7e1648d68fc91b66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91b6d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123127.180778:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33000 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:1.0:1789123127.180783:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f343bd33000/0x7e1648d68fc91b66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc91b6d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123127.180792:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f343bd33000/0x7e1648d68fc91b66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc91b6d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789123127.180799:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f343bd33000/0x7e1648d68fc91b66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc91b6d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789123127.180804:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789123127.180834:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f343bd33000/0x7e1648d68fc91b66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91b6d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123127.180840:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789123127.180859:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f343bd33000/0x7e1648d68fc91b66 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91b6d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123127.180866:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f343bd33000/0x7e1648d68fc91b66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91b6d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123127.180881:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123127.180883:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123127.180884:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123127.180904:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34063b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381225600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789123127.180946:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123127.180987:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381225600 00000100:00100000:1.0:1789123127.180991:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381225600 00010000:00010000:1.0:1789123127.181005:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f3435b52600/0x7e1648d68fc91b6d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91b66 expref: 17 pid: 5835 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123127.181024:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789123127.181029:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:3304:x1876031381225600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789123127.181037:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123127.181041:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f3435b52600/0x7e1648d68fc91b6d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91b66 expref: 17 pid: 5835 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123127.181050:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f3435b52600/0x7e1648d68fc91b6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc91b66 expref: 17 pid: 5835 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123127.181063:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91bc1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123127.181072:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91bc1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123127.181086:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91bc1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123127.181094:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91bc1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123127.181101:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91bc1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123127.181107:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91bc1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123127.181118:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34029f2e00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123127.181122:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91bc1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123127.181131:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91bc1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123127.181140:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91bc1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123127.181149:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789123127.181173:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:3304:x1876031381225600:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123127.181180:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789123127.181207:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34063b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381225600:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789123127.183469:0:11169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f34029f3200/0x7e1648d68fc91ba5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4c4 expref: 12 pid: 5833 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123127.183507:0:11169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34354f2d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1876031381224704:192.168.206.30@tcp:104: 00010000:00010000:3.0:1789123127.183522:0:11169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3401514e00/0x7e1648d68fc91b82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f48c expref: 11 pid: 5835 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123127.183530:0:11169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34354f0b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1876031381224960:192.168.206.30@tcp:104: 00010000:00010000:3.0:1789123127.183541:0:11169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3435b52600/0x7e1648d68fc91b6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc91b66 expref: 16 pid: 5835 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123127.183549:0:11169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f340665ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11169:1876031381225216:0@lo:104: 00010000:00010000:3.0:1789123127.183586:0:11169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91bc1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123127.183598:0:11169:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91bc1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123127.183605:0:11169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91bc1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123127.183612:0:11169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91bc1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123127.200081:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123127.201253:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364413952 00000100:00100000:1.0:1789123127.201268:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364413952 00000100:00100000:1.0:1789123127.201357:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 86 00000100:00100000:1.0:1789123127.201368:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2352:x1876031364413952:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123127.201460:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2352:x1876031364413952:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 94us (1387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123127.201468:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 86 00000100:00080000:0.0:1789123127.201855:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789123127.215249:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123127.215671:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364413824 00000100:00100000:3.0:1789123127.215681:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364413824 00000100:00100000:3.0:1789123127.215760:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 87 00000100:00100000:3.0:1789123127.215781:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343551ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2353:x1876031364413824:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1789123127.215868:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343551ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2353:x1876031364413824:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 89us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123127.215875:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 87 00000100:00080000:2.0:1789123127.216029:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789123127.812994:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789123128.582137:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789123128.582146:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f3406274800 from 7 10000000:01000000:2.0:1789123128.582150:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789123128.582202:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f342d80b800/0x7e1648d68fc91bc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123128.582213:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f342d80b800/0x7e1648d68fc91bc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123128.582225:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f342d80b800/0x7e1648d68fc91bc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123128.582249:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343551b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381225728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789123128.582335:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123128.582389:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408e59900 going to sleep for 11 seconds 00000100:00100000:3.0:1789123128.582445:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381225728 00000100:00100000:3.0:1789123128.582453:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381225728 00000100:00100000:3.0:1789123128.582505:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789123128.582515:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:5838:x1876031381225728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789123128.582527:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123128.582540:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91bcf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91bc8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123128.582572:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91bcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91bc8 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123128.582583:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91bcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91bc8 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123128.582606:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f34029f2e00, rc 0) 00000100:00100000:3.0:1789123128.582673:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381225728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123128.582680:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789123128.582830:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343551b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381225728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789123128.582846:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f342d80b800/0x7e1648d68fc91bc8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91bcf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123128.582866:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f342d80b800/0x7e1648d68fc91bc8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91bcf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123128.582924:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34063b4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381225856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789123128.582957:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123128.582990:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34191c6840 going to sleep for 11 seconds 00000100:00100000:3.0:1789123128.583132:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381225856 00000100:00100000:3.0:1789123128.583137:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381225856 00000100:00100000:3.0:1789123128.583170:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789123128.583178:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381225856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789123128.583414:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381225856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123128.583428:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789123128.583494:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34063b4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381225856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789123128.583527:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34063b4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381225984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789123128.583565:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123128.583586:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34191c6840 going to sleep for 11 seconds 00000100:00100000:2.0:1789123128.583719:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381225984 00000100:00100000:2.0:1789123128.583723:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381225984 00000100:00100000:2.0:1789123128.583752:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789123128.583759:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381225984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789123128.583909:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381225984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123128.583916:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789123128.585857:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34063b4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381225984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789123128.587505:0:11206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789123128.590131:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789123128.590162:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789123128.590175:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f342d80b800/0x7e1648d68fc91bc8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91bcf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123128.590189:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f342d80b800/0x7e1648d68fc91bc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91bcf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789123128.590254:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789123128.590258:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f343be04000 from 7 10000000:01000000:0.0:1789123128.590261:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789123128.590303:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3435b53800/0x7e1648d68fc91bd6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123128.590312:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f3435b53800/0x7e1648d68fc91bd6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123128.590322:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f3435b53800/0x7e1648d68fc91bd6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123128.590360:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381226112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789123128.590443:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123128.590495:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3303e6c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789123128.591012:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381226112 00000100:00100000:2.0:1789123128.591029:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381226112 00000100:00100000:2.0:1789123128.591081:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789123128.591090:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381226112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789123128.591105:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123128.591120:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f342d80a400/0x7e1648d68fc91bdd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91bd6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123128.591148:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f342d80a400/0x7e1648d68fc91bdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91bd6 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123128.591159:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f342d80a400/0x7e1648d68fc91bdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91bd6 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123128.591168:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80a400, rc 0) 00000100:00100000:2.0:1789123128.591221:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381226112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123128.591228:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789123128.591275:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381226112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789123128.591305:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f3435b53800/0x7e1648d68fc91bd6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91bdd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123128.591314:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f3435b53800/0x7e1648d68fc91bd6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91bdd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123128.591370:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343551a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381226240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789123128.591397:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123128.591421:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381226240 00000100:00100000:2.0:1789123128.591425:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381226240 00000100:00100000:2.0:1789123128.591447:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789123128.591453:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381226240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789123128.591739:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381226240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 284us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123128.591746:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789123128.591771:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408e59e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789123128.591783:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343551a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381226240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789123128.591811:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343551a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381226368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789123128.591848:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123128.591867:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381226368 00000100:00100000:2.0:1789123128.591871:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381226368 00000100:00100000:2.0:1789123128.591893:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789123128.591899:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381226368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789123128.592034:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381226368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123128.592040:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789123128.592077:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408e59e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789123128.592089:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343551a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381226368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789123128.592774:0:11207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789123128.592835:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789123128.592850:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789123128.592860:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3435b53800/0x7e1648d68fc91bd6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91bdd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123128.592869:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f3435b53800/0x7e1648d68fc91bd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91bdd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123128.592879:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789123128.592882:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f3408401800 from 7 10000000:01000000:2.0:1789123128.592885:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789123128.592911:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f342d80bc00/0x7e1648d68fc91be4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123128.592918:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f342d80bc00/0x7e1648d68fc91be4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123128.592927:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f342d80bc00/0x7e1648d68fc91be4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123128.592943:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343551a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381226496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789123128.592976:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123128.592993:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408e59c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789123128.593008:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381226496 00000100:00100000:2.0:1789123128.593012:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381226496 00000100:00100000:2.0:1789123128.593039:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789123128.593046:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381226496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789123128.593064:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123128.593077:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f342d80b400/0x7e1648d68fc91beb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91be4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123128.593097:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f342d80b400/0x7e1648d68fc91beb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91be4 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123128.593106:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f342d80b400/0x7e1648d68fc91beb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91be4 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123128.593114:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80b400, rc 0) 00000100:00100000:2.0:1789123128.593146:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:5838:x1876031381226496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123128.593153:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789123128.593190:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343551a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381226496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789123128.593202:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f342d80bc00/0x7e1648d68fc91be4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91beb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123128.593210:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f342d80bc00/0x7e1648d68fc91be4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91beb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123128.593249:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343551a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381226624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789123128.593272:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123128.593284:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408e59c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789123128.593294:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381226624 00000100:00100000:2.0:1789123128.593297:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381226624 00000100:00100000:2.0:1789123128.593314:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789123128.593319:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:5838:x1876031381226624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789123128.593520:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:5838:x1876031381226624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 199us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123128.593527:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789123128.593564:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343551a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381226624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789123128.593588:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343551a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381226752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789123128.593625:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123128.593664:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408e59c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789123128.593675:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381226752 00000100:00100000:2.0:1789123128.593678:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381226752 00000100:00100000:2.0:1789123128.593699:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789123128.593719:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:5838:x1876031381226752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789123128.595849:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343551a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381226752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789123128.603858:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:5838:x1876031381226752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123128.603960:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000040:00080000:1.0:1789123128.605390:0:11209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789123128.605563:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789123128.605589:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789123128.605601:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f342d80bc00/0x7e1648d68fc91be4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91beb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123128.605613:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f342d80bc00/0x7e1648d68fc91be4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91beb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123128.839897:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123128.923952:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123128.924057:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364414080 00000100:00100000:2.0:1789123128.924069:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364414080 00000100:00100000:2.0:1789123128.924133:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 237 00000100:00100000:2.0:1789123128.924414:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+11:5592:x1876031364414080:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789123128.924443:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123128.924461:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f342d80ae00/0x7e1648d68fc91bf2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f4ee expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123128.924492:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f342d80ae00/0x7e1648d68fc91bf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4ee expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123128.924503:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f342d80ae00/0x7e1648d68fc91bf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4ee expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123128.924511:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80ae00, rc 0) 00000100:00100000:2.0:1789123128.924573:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+12:5592:x1876031364414080:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 Request processed in 167us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123128.941019:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 237 00000100:00100000:1.0:1789123128.949862:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123128.949947:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364414208 00000100:00100000:1.0:1789123128.949958:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364414208 00000100:00100000:1.0:1789123128.950013:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 238 00000100:00100000:1.0:1789123128.950022:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+12:5592:x1876031364414208:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789123128.950827:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+12:5592:x1876031364414208:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 Request processed in 799us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123128.950839:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 238 00000100:00100000:1.0:1789123128.961971:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123128.962808:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364414336 00000100:00100000:0.0:1789123128.962821:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364414336 00000100:00100000:0.0:1789123128.962894:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 239 00000100:00100000:0.0:1789123128.962904:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+12:5592:x1876031364414336:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789123128.963418:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+12:5592:x1876031364414336:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 Request processed in 514us (1455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123128.963430:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 239 00000100:00100000:1.0:1789123128.980437:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123128.980751:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364414464 00000100:00100000:2.0:1789123128.980834:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364414464 00000100:00100000:2.0:1789123128.980902:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 240 00000100:00100000:2.0:1789123128.980914:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+12:5592:x1876031364414464:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789123128.980936:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123128.980957:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f342d80b600/0x7e1648d68fc91bf9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f4f5 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123128.980987:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f342d80b600/0x7e1648d68fc91bf9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4f5 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123128.980998:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f342d80b600/0x7e1648d68fc91bf9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4f5 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123128.981019:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80b600, rc 0) 00000100:00100000:2.0:1789123128.981367:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+13:5592:x1876031364414464:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 Request processed in 454us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123128.981375:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 240 00000100:00100000:1.0:1789123129.000838:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123129.000972:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364414592 00000100:00100000:0.0:1789123129.000981:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364414592 00000100:00100000:0.0:1789123129.001032:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 241 00000100:00100000:0.0:1789123129.001044:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+13:5592:x1876031364414592:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789123129.001360:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+13:5592:x1876031364414592:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 Request processed in 318us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123129.001368:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 241 00000100:00100000:2.0:1789123129.006091:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123129.006178:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364414720 00000100:00100000:1.0:1789123129.006190:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364414720 00000100:00100000:1.0:1789123129.006262:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 242 00000100:00100000:1.0:1789123129.006273:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+13:5592:x1876031364414720:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789123129.006534:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+13:5592:x1876031364414720:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 Request processed in 262us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123129.006543:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 242 00000100:00100000:2.0:1789123129.351066:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381226880:0@lo:400:kworker.0 00000100:00100000:2.0:1789123129.351161:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123129.351217:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381227392:0@lo:400:kworker.0 00000100:00100000:2.0:1789123129.351243:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123129.351267:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789123129.351272:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381227264:0@lo:400:kworker.0 00000100:00100000:2.0:1789123129.351292:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123129.351317:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381227008:0@lo:400:kworker.0 00000100:00100000:2.0:1789123129.351337:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123129.351351:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381227520:0@lo:400:kworker.0 00000100:00100000:2.0:1789123129.351367:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123129.351382:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789123129.351386:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381227136:0@lo:400:kworker.0 00000100:00100000:2.0:1789123129.351403:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123129.351434:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381227392 00000100:00100000:2.0:1789123129.351439:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381227392 00000100:00100000:2.0:1789123129.351486:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381227008 00000100:00100000:2.0:1789123129.351488:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381227008 00000100:00100000:2.0:1789123129.351498:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381227136 00000100:00100000:2.0:1789123129.351500:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381227136 00000100:00100000:2.0:1789123129.351528:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789123129.351535:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343551bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876031381227392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123129.351582:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343551bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876031381227392:12345-0@lo:400:kworker.0 Request processed in 47us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123129.351589:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789123129.351618:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789123129.351649:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343551b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381227008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123129.351832:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381226880 00000100:00100000:0.0:1789123129.351836:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381226880 00000100:00100000:0.0:1789123129.351864:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789123129.351870:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3305:x1876031381226880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123129.351904:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3305:x1876031381226880:12345-0@lo:400:kworker.0 Request processed in 34us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123129.351911:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789123129.352043:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789123129.352051:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381227136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123129.352085:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381227136:12345-0@lo:400:kworker.0 Request processed in 35us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123129.352092:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789123129.352164:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34063b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381227648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789123129.352193:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123129.352273:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381227648 00000100:00100000:1.0:1789123129.352278:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381227648 00000100:00100000:1.0:1789123129.352312:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789123129.352318:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381227648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789123129.352344:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789123129.352386:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381227648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123129.352392:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1789123129.352423:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34063b4b40 x1876031381227648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123145 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123129.352440:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34063b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381227648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789123129.352503:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343551b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381227008:12345-0@lo:400:kworker.0 Request processed in 878us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123129.352509:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789123129.352530:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381227264 00000100:00100000:2.0:1789123129.352534:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381227264 00000100:00100000:2.0:1789123129.352565:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381227520 00000100:00100000:2.0:1789123129.352568:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381227520 00000100:00100000:2.0:1789123129.352586:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789123129.352592:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343551a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381227264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123129.352621:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343551a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381227264:12345-0@lo:400:kworker.0 Request processed in 30us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123129.352646:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789123129.352657:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1789123129.352983:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789123129.352988:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789123129.352991:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789123129.354411:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381227520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123129.354492:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381227520:12345-0@lo:400:kworker.0 Request processed in 98us (3122us total) trans 0 rc 0/0 00010000:00080000:1.0:1789123129.354809:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34365cf0c0 x1876031381227264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123129.354826:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381227264:0@lo:400:kworker.0 00000100:00100000:1.0:1789123129.354838:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381226880:0@lo:400:kworker.0 00000100:00100000:1.0:1789123129.354851:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381227392:0@lo:400:kworker.0 00000100:00100000:0.0:1789123129.359858:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381227136:0@lo:400:kworker.0 00000100:00100000:0.0:1789123129.359877:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381227008:0@lo:400:kworker.0 00010000:00080000:0.0:1789123129.359892:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34365ce940 x1876031381227520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123129.359903:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381227520:0@lo:400:kworker.0 00000100:00100000:2.0:1789123129.362413:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00010000:3.0:1789123129.865183:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123130.886338:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789123130.886361:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34063b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381227776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789123130.886427:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123130.886495:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381227776 00000100:00100000:1.0:1789123130.886502:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381227776 00000100:00100000:1.0:1789123130.886550:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789123130.886560:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381227776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789123130.886597:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789123130.886660:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381227776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123130.886668:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1789123130.886722:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34063b4b40 x1876031381227776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123146 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123130.886758:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34063b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381227776:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789123130.890045:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789123131.265979:0:11366:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789123131.908943:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123132.316148:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123132.316196:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123132.316233:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123132.316341:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364415104 00000100:00100000:3.0:1789123132.316351:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364415104 00000100:00100000:3.0:1789123132.316423:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364414976 00000100:00100000:3.0:1789123132.316426:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364414976 00000100:00100000:3.0:1789123132.316448:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 91 00000100:00100000:3.0:1789123132.316458:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2353:x1876031364415104:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1789123132.316540:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2353:x1876031364415104:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 83us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123132.316549:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 91 00000100:00100000:3.0:1789123132.316569:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 92 00000100:00100000:3.0:1789123132.316575:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2353:x1876031364414976:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1789123132.316617:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2353:x1876031364414976:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 41us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123132.316662:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 92 00000100:00080000:1.0:1789123132.316790:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789123132.317092:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364414848 00000100:00100000:2.0:1789123132.317098:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364414848 00000100:00100000:2.0:1789123132.317139:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 244 00000100:00100000:2.0:1789123132.317147:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+13:2353:x1876031364414848:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1789123132.317179:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+13:2353:x1876031364414848:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 33us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123132.317186:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 244 00010000:00010000:2.0:1789123132.932852:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123133.956926:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123134.470224:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34063b7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876031381228160:0@lo:400:kworker.0 00000100:00100000:1.0:1789123134.470302:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123134.470367:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3418488b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381228672:0@lo:400:kworker.0 00000100:00100000:1.0:1789123134.470397:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123134.470430:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789123134.470436:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34063b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd41f4a0-f4e3-41a1-856e-0c34af912023:3303:1876031381228032:0@lo:400:kworker.0 00000100:00100000:1.0:1789123134.470464:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123134.470484:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f341848b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876031381228544:0@lo:400:kworker.0 00000100:00100000:1.0:1789123134.470505:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123134.470535:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381228672 00000100:00100000:1.0:1789123134.470542:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381228672 00000100:00100000:1.0:1789123134.470593:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789123134.470603:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f341848b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381228672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123134.470693:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f341848b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381228672:12345-0@lo:400:kworker.0 Request processed in 90us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123134.470702:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789123134.470724:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381228032 00000100:00100000:1.0:1789123134.470727:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381228032 00000100:00100000:1.0:1789123134.470749:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789123134.470755:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3303:x1876031381228032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123134.470804:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3303:x1876031381228032:12345-0@lo:400:kworker.0 Request processed in 49us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123134.470811:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1789123134.470838:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789123134.470865:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34063b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd41f4a0-f4e3-41a1-856e-0c34af912023:3303:1876031381228032:0@lo:400:kworker.0 00010000:00080000:1.0:1789123134.470883:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3418488b40 x1876031381228672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123134.470894:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3418488b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381228672:0@lo:400:kworker.0 00000100:00100000:0.0:1789123134.470987:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381228160 00000100:00100000:0.0:1789123134.470992:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381228160 00000100:00100000:0.0:1789123134.471031:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381228544 00000100:00100000:0.0:1789123134.471034:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381228544 00000100:00100000:0.0:1789123134.471057:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789123134.471063:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3418488780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876031381228160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123134.471106:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3418488780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876031381228160:12345-0@lo:400:kworker.0 Request processed in 43us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123134.471112:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789123134.471125:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789123134.471131:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3418489a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876031381228544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123134.471156:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3418489a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876031381228544:12345-0@lo:400:kworker.0 Request processed in 26us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123134.471161:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1789123134.471182:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789123134.471200:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f341848b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876031381228544:0@lo:400:kworker.0 00000100:00100000:0.0:1789123134.471210:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34063b7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876031381228160:0@lo:400:kworker.0 00000100:00100000:3.0:1789123134.472012:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381228288:0@lo:400:kworker.0 00000100:00100000:3.0:1789123134.472058:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123134.472099:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789123134.472106:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34063b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381227904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789123134.472130:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123134.472151:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f341848a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381228416:0@lo:400:kworker.0 00000100:00100000:3.0:1789123134.472177:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123134.472307:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381227904 00000100:00100000:3.0:1789123134.472313:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381227904 00000100:00100000:3.0:1789123134.472353:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789123134.472361:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381227904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789123134.472400:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123134.472439:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381228288 00000100:00100000:2.0:1789123134.472445:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381228288 00000100:00100000:3.0:1789123134.472447:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381227904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123134.472455:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789123134.472478:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381228416 00000100:00100000:2.0:1789123134.472493:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789123134.472495:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381228416 00000100:00100000:2.0:1789123134.472504:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381228288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123134.472530:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789123134.472539:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381228416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123134.472555:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381228288:12345-0@lo:400:kworker.0 Request processed in 53us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123134.472564:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789123134.472581:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381228416:12345-0@lo:400:kworker.0 Request processed in 42us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123134.472589:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1789123134.472603:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789123134.472609:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789123134.472654:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34063b4780 x1876031381227904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123150 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123134.472683:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34063b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381227904:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789123134.472695:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f341848a940 x1876031381228416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123134.472705:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f341848a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381228416:0@lo:400:kworker.0 00000100:00100000:3.0:1789123134.472716:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381228288:0@lo:400:kworker.0 00010000:00010000:2.0:1789123134.981166:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123136.005973:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789123136.005993:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381228800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789123136.006058:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123136.007803:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381228800 00000100:00100000:2.0:1789123136.007816:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381228800 00000100:00100000:2.0:1789123136.007874:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789123136.007884:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435672d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381228800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789123136.007916:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123136.007981:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435672d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381228800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (1922us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123136.008000:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1789123136.008020:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789123136.008053:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3409cb4780 x1876031381228800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123136.008073:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381228800:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789123136.009314:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789123136.949467:0:11612:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc2ebee1f0 20000000:00000080:0.0:1789123136.949487:0:11612:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f343bd36400 uarg=0000000000000000 20000000:01000000:0.0:1789123136.950050:0:11612:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:0.0:1789123136.950057:0:11612:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:0.0:1789123136.950064:0:11612:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 del=0 00000040:00080000:3.0:1789123136.951922:0:11613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789123136.952104:0:11612:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 in log params 00000040:00080000:0.0:1789123136.961048:0:11612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789123136.961101:0:11612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 144 off9680 00000040:00080000:0.0:1789123136.961159:0:11612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9904 10000000:01000000:0.0:1789123136.961933:0:11612:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789123136.961956:0:11612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f3435b53a00/0x7e1648d68fc91c00 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123136.961975:0:11612:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91bcf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91bc8 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123136.961981:0:11612:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f342d80a400/0x7e1648d68fc91bdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91bd6 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123136.961987:0:11612:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f342d80b400/0x7e1648d68fc91beb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91be4 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123136.961996:0:11612:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f342d80ae00/0x7e1648d68fc91bf2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4ee expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123136.962002:0:11612:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f342d80b600/0x7e1648d68fc91bf9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4f5 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123136.962008:0:11612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f3435b53a00/0x7e1648d68fc91c00 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123136.962045:0:11612:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f342d80b600/0x7e1648d68fc91bf9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4f5 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123136.962060:0:11612:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f342d80b600/0x7e1648d68fc91bf9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4f5 expref: 12 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123136.962074:0:11612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365ce940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11612:1876031381228928:192.168.206.30@tcp:104: 00010000:00010000:0.0:1789123136.962247:0:11612:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f342d80ae00/0x7e1648d68fc91bf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4ee expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123136.962272:0:11612:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f342d80ae00/0x7e1648d68fc91bf2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4ee expref: 12 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123136.962293:0:11612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11612:1876031381229056:192.168.206.30@tcp:104: 00010000:00010000:0.0:1789123136.962338:0:11612:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f342d80b400/0x7e1648d68fc91beb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc91be4 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123136.962347:0:11612:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f342d80b400/0x7e1648d68fc91beb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc91be4 expref: 18 pid: 5833 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123136.962356:0:11612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cd2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11612:1876031381229184:0@lo:104: 00000100:00100000:0.0:1789123136.962397:0:11612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789123136.962442:0:11612:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f342d80a400/0x7e1648d68fc91bdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc91bd6 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123136.962451:0:11612:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f342d80a400/0x7e1648d68fc91bdd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc91bd6 expref: 18 pid: 5835 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123136.962459:0:11612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cfc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11612:1876031381229312:0@lo:104: 00000100:00100000:0.0:1789123136.962481:0:11612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789123136.962514:0:11612:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91bcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc91bc8 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123136.962522:0:11612:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91bcf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc91bc8 expref: 18 pid: 5835 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123136.962529:0:11612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cf840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11612:1876031381229440:0@lo:104: 00000100:00100000:0.0:1789123136.962550:0:11612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123136.962570:0:11612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340679a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789123136.962620:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789123136.962655:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381229184 00000100:00100000:2.0:1789123136.962673:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381229184 00000100:00100000:2.0:1789123136.962714:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381229312 00000100:00100000:2.0:1789123136.962718:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381229312 00000100:00100000:2.0:1789123136.962731:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381229440 00000100:00100000:2.0:1789123136.962733:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381229440 00000100:00100000:2.0:1789123136.962759:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789123136.962770:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+5:11612:x1876031381229184:12345-0@lo:104: 00010000:00010000:2.0:1789123136.962789:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f342d80bc00/0x7e1648d68fc91be4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91beb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123136.963048:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789123136.963056:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+5:11612:x1876031381229184:12345-0@lo:104: Request processed in 288us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123136.963061:0:11612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cd2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11612:1876031381229184:0@lo:104: 00000100:00100000:2.0:1789123136.963074:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789123136.963096:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789123136.963104:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+4:11612:x1876031381229312:12345-0@lo:104: 00010000:00010000:2.0:1789123136.963112:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f3435b53800/0x7e1648d68fc91bd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91bdd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123136.963250:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789123136.963470:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+4:11612:x1876031381229312:12345-0@lo:104: Request processed in 164us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123136.963478:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789123136.963494:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789123136.963500:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d80f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:11612:x1876031381229440:12345-0@lo:104: 00010000:00010000:2.0:1789123136.963509:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f342d80b800/0x7e1648d68fc91bc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91bcf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123136.963541:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789123136.963546:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d80f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:11612:x1876031381229440:12345-0@lo:104: Request processed in 47us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123136.963552:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1789123136.963594:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789123136.963600:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f342d80bc00/0x7e1648d68fc91be4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91beb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123136.963607:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80bc00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1789123136.963611:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f342d80bc00/0x7e1648d68fc91be4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc91beb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123136.963618:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f342d80bc00/0x7e1648d68fc91be4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc91beb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789123136.963648:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f342d80bc00/0x7e1648d68fc91be4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc91beb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123136.963655:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789123136.963701:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f342d80bc00/0x7e1648d68fc91be4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91beb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123136.963718:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789123136.964088:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f342d80bc00/0x7e1648d68fc91be4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91beb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123136.964099:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f342d80bc00/0x7e1648d68fc91be4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91beb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123136.964115:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789123136.964119:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f3435b53800/0x7e1648d68fc91bd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91bdd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123136.964408:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53800 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1789123136.964413:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f3435b53800/0x7e1648d68fc91bd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc91bdd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123136.964423:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f3435b53800/0x7e1648d68fc91bd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc91bdd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789123136.964429:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f3435b53800/0x7e1648d68fc91bd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc91bdd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123136.964440:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789123136.964519:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f3435b53800/0x7e1648d68fc91bd6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91bdd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123136.964525:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789123136.964581:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435673840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381229696:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789123136.965386:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f3435b53800/0x7e1648d68fc91bd6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91bdd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123136.965399:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f3435b53800/0x7e1648d68fc91bd6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91bdd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123136.965430:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789123136.965434:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f342d80b800/0x7e1648d68fc91bc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91bcf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123136.965440:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80b800 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1789123136.965443:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f342d80b800/0x7e1648d68fc91bc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc91bcf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123136.965451:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f342d80b800/0x7e1648d68fc91bc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc91bcf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789123136.965457:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f342d80b800/0x7e1648d68fc91bc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc91bcf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123136.965462:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789123136.965492:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f342d80b800/0x7e1648d68fc91bc8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91bcf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123136.965498:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789123136.965507:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f342d80b800/0x7e1648d68fc91bc8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91bcf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123136.965513:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f342d80b800/0x7e1648d68fc91bc8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91bcf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123136.965528:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123136.965530:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123136.965532:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123136.965542:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123136.965565:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435671680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381229568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789123136.965618:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34356730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd41f4a0-f4e3-41a1-856e-0c34af912023:3303:1876031381229824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789123136.966155:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123136.966489:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381229696 00000100:00100000:2.0:1789123136.966498:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381229696 00010000:00010000:2.0:1789123136.966538:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f342d80a400/0x7e1648d68fc91bdd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91bd6 expref: 19 pid: 5835 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123136.966587:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789123136.966596:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3302:x1876031381229696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789123136.966610:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123136.966615:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f342d80a400/0x7e1648d68fc91bdd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91bd6 expref: 19 pid: 5835 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123136.966646:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f342d80a400/0x7e1648d68fc91bdd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc91bd6 expref: 19 pid: 5835 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123136.966674:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123136.966725:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3302:x1876031381229696:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123136.966732:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789123136.966770:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123136.966800:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381229568 00000100:00100000:2.0:1789123136.966804:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381229568 00010000:00010000:2.0:1789123136.966817:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f342d80b400/0x7e1648d68fc91beb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91be4 expref: 19 pid: 5833 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123136.966850:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789123136.966857:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435673c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3305:x1876031381229568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789123136.966876:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123136.966881:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f342d80b400/0x7e1648d68fc91beb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91be4 expref: 19 pid: 5833 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123136.966889:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f342d80b400/0x7e1648d68fc91beb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc91be4 expref: 19 pid: 5833 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123136.966900:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f342d80b400/0x7e1648d68fc91beb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc91be4 expref: 19 pid: 5833 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123136.966912:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123136.966947:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435673c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:3305:x1876031381229568:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123136.966954:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789123136.966979:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789123136.967025:0:11612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f342d80a400/0x7e1648d68fc91bdd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc91bd6 expref: 17 pid: 5835 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123136.967034:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435671680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381229568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789123136.967042:0:11612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cfc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11612:1876031381229312:0@lo:104: 00000100:00100000:0.0:1789123136.967059:0:11612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cf840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11612:1876031381229440:0@lo:104: 00000100:00100000:2.0:1789123136.967062:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381229824 00000100:00100000:2.0:1789123136.967067:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381229824 00010000:00010000:2.0:1789123136.967081:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91bcf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91bc8 expref: 17 pid: 5835 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123136.967095:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789123136.967102:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3406287050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:3303:x1876031381229824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789123136.967108:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123136.967112:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91bcf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91bc8 expref: 17 pid: 5835 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123136.967119:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91bcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc91bc8 expref: 17 pid: 5835 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123136.967155:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f34029f2e00/0x7e1648d68fc91bcf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc91bc8 expref: 17 pid: 5835 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123136.967165:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123136.967211:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3406287050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:3303:x1876031381229824:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123136.967219:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789123136.967537:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435673840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381229696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789123136.967947:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34356730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd41f4a0-f4e3-41a1-856e-0c34af912023:3303:1876031381229824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789123136.988581:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123136.988687:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364415232 00000100:00100000:2.0:1789123136.988698:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364415232 00010000:00010000:2.0:1789123136.988736:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f342d80b600/0x7e1648d68fc91bf9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4f5 expref: 13 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123136.988772:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 33 00000100:00100000:2.0:1789123136.988783:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3418488b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19924a15-1c73-4644-a9ca-864666412d45+13:2352:x1876031364415232:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789123136.988797:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123136.988803:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f342d80b600/0x7e1648d68fc91bf9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4f5 expref: 13 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123136.988819:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f342d80b600/0x7e1648d68fc91bf9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4f5 expref: 13 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123136.988822:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00010000:00010000:2.0:1789123136.988846:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789123136.988854:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789123136.988864:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1789123136.988970:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364415360 00000100:00100000:1.0:1789123136.988974:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364415360 00010000:00010000:1.0:1789123136.988993:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f342d80ae00/0x7e1648d68fc91bf2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4ee expref: 14 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123136.989008:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789123136.989014:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 34 00000100:00100000:1.0:1789123136.989020:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f341848bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19924a15-1c73-4644-a9ca-864666412d45+14:2352:x1876031364415360:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789123136.989028:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123136.989033:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f342d80ae00/0x7e1648d68fc91bf2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4ee expref: 14 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123136.989043:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f342d80ae00/0x7e1648d68fc91bf2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4ee expref: 14 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123136.989077:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f3435b53a00/0x7e1648d68fc91c00 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123136.989087:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3418488b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:19924a15-1c73-4644-a9ca-864666412d45+14:2352:x1876031364415232:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 303us (516us total) trans 0 rc 0/0 00010000:00010000:1.0:1789123136.989087:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3435b53a00/0x7e1648d68fc91c00 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123136.989102:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 33 00010000:00010000:1.0:1789123136.989111:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f3435b53a00/0x7e1648d68fc91c00 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123136.989120:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f3435b53a00/0x7e1648d68fc91c00 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123136.989127:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f3435b53a00/0x7e1648d68fc91c00 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123136.989134:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f3435b53a00/0x7e1648d68fc91c00 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123136.989141:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53a00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123136.989145:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f3435b53a00/0x7e1648d68fc91c00 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123136.989154:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f3435b53a00/0x7e1648d68fc91c00 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123136.989164:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f3435b53a00/0x7e1648d68fc91c00 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123136.989176:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789123136.989200:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f341848bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19924a15-1c73-4644-a9ca-864666412d45+13:2352:x1876031364415360:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 178us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123136.989217:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 34 00010000:00010000:0.0:1789123136.989498:0:11612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f342d80b600/0x7e1648d68fc91bf9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4f5 expref: 12 pid: 5835 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123136.989509:0:11612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365ce940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11612:1876031381228928:192.168.206.30@tcp:104: 00010000:00010000:0.0:1789123136.989522:0:11612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f342d80ae00/0x7e1648d68fc91bf2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4ee expref: 11 pid: 5834 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123136.989530:0:11612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11612:1876031381229056:192.168.206.30@tcp:104: 00010000:00010000:0.0:1789123136.989562:0:11612:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f3435b53a00/0x7e1648d68fc91c00 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123136.989571:0:11612:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f3435b53a00/0x7e1648d68fc91c00 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123136.989577:0:11612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f3435b53a00/0x7e1648d68fc91c00 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123136.989582:0:11612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3435b53a00/0x7e1648d68fc91c00 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123137.031821:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123137.436296:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123137.436348:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123137.436382:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364415488 00000100:00100000:3.0:1789123137.436391:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364415488 00000100:00100000:3.0:1789123137.436447:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364415616 00000100:00100000:3.0:1789123137.436451:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364415616 00000100:00100000:3.0:1789123137.436477:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 96 00000100:00100000:3.0:1789123137.436487:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2352:x1876031364415488:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1789123137.436564:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2352:x1876031364415488:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 78us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123137.436572:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 96 00000100:00100000:3.0:1789123137.436590:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 97 00000100:00100000:3.0:1789123137.436597:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2352:x1876031364415616:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1789123137.436647:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2352:x1876031364415616:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 27us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123137.436665:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 97 00000100:00080000:3.0:1789123137.436683:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:2.0:1789123138.052792:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789123138.052816:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f3406274800 from 7 10000000:01000000:2.0:1789123138.052821:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789123138.052869:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f342d80b200/0x7e1648d68fc91c07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123138.052881:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f342d80b200/0x7e1648d68fc91c07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123138.052904:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f342d80b200/0x7e1648d68fc91c07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123138.052930:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435673840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381229952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789123138.053006:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123138.053059:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34183669c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789123138.053277:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381229952 00000100:00100000:0.0:1789123138.053293:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381229952 00000100:00100000:0.0:1789123138.053350:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789123138.053359:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:5838:x1876031381229952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789123138.053373:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123138.053386:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3435b52a00/0x7e1648d68fc91c0e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91c07 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123138.053409:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3435b52a00/0x7e1648d68fc91c0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91c07 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123138.053418:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3435b52a00/0x7e1648d68fc91c0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91c07 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123138.053428:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b52a00, rc 0) 00000100:00100000:0.0:1789123138.053476:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381229952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123138.053483:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789123138.053679:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435673840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381229952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789123138.053693:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f342d80b200/0x7e1648d68fc91c07 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91c0e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123138.053702:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f342d80b200/0x7e1648d68fc91c07 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91c0e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123138.053750:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435673840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381230080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789123138.053773:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123138.053796:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34183669c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789123138.053860:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123138.053980:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381230080 00000100:00100000:0.0:1789123138.053985:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381230080 00000100:00100000:0.0:1789123138.054016:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789123138.054023:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381230080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789123138.054263:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381230080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 239us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123138.054270:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789123138.054294:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435673840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381230080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789123138.054338:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184883c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381230208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789123138.055183:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123138.055261:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f342d734780 going to sleep for 11 seconds 00000100:00100000:2.0:1789123138.058607:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381230208 00000100:00100000:2.0:1789123138.058621:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381230208 00000100:00100000:2.0:1789123138.058741:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789123138.058751:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381230208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789123138.060124:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381230208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1369us (4937us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123138.060147:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789123138.060250:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184883c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381230208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789123138.061703:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184883c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:11674:1876031381230336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789123138.061777:0:11674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123138.061823:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f342d734a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789123138.061975:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381230336 00000100:00100000:3.0:1789123138.061982:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381230336 00000100:00100000:3.0:1789123138.062028:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789123138.062036:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:11674:x1876031381230336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789123138.062253:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:11674:x1876031381230336:12345-0@lo:502:llog_process_th.0 Request processed in 217us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123138.062260:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789123138.062517:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184883c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:11674:1876031381230336:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789123138.062558:0:11674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789123138.062568:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789123138.062570:0:11674:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789123138.062578:0:11674:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f3406274800 00000020:00000080:1.0:1789123138.062581:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789123138.062729:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184883c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:11674:1876031381230464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789123138.062765:0:11674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123138.062789:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f342d734a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789123138.062972:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381230464 00000100:00100000:0.0:1789123138.062977:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381230464 00000100:00100000:0.0:1789123138.063007:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789123138.063021:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:11674:x1876031381230464:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789123138.063178:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:11674:x1876031381230464:12345-0@lo:502:llog_process_th.0 Request processed in 158us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123138.063185:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789123138.063716:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184883c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:11674:1876031381230464:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789123138.063740:0:11674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789123138.063746:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789123138.063748:0:11674:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:0.0:1789123138.063752:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789123138.063878:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789123138.063899:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789123138.063910:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f342d80b200/0x7e1648d68fc91c07 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91c0e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123138.063921:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f342d80b200/0x7e1648d68fc91c07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91c0e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789123138.063944:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789123138.063947:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f343be04000 from 7 10000000:01000000:1.0:1789123138.063950:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789123138.063979:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91c15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123138.063986:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91c15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123138.063995:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91c15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123138.064010:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f341848a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381230592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789123138.064049:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123138.064085:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f342d734d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789123138.064548:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381230592 00000100:00100000:0.0:1789123138.064556:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381230592 00000100:00100000:0.0:1789123138.064603:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789123138.064611:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381230592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789123138.064647:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123138.064669:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3435b52200/0x7e1648d68fc91c1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91c15 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123138.064691:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3435b52200/0x7e1648d68fc91c1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91c15 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123138.064701:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3435b52200/0x7e1648d68fc91c1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91c15 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123138.064709:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b52200, rc 0) 00000100:00100000:0.0:1789123138.064755:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381230592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123138.064761:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789123138.064878:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f341848a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381230592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789123138.064893:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91c15 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91c1c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123138.064902:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91c15 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91c1c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123138.064954:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f341848a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381230720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789123138.064984:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123138.065015:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f342d734d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789123138.065550:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381230720 00000100:00100000:0.0:1789123138.065557:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381230720 00000100:00100000:0.0:1789123138.065597:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1789123138.065605:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381230720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789123138.065864:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381230720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123138.065871:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1789123138.065921:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f341848a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381230720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789123138.065954:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381230848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789123138.065991:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123138.066007:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340679a900 going to sleep for 11 seconds 00000100:00100000:0.0:1789123138.066018:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381230848 00000100:00100000:0.0:1789123138.066021:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381230848 00000100:00100000:0.0:1789123138.066037:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789123138.066042:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381230848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789123138.066167:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381230848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123138.066174:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789123138.066211:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381230848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789123138.066355:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:11675:1876031381230976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789123138.066386:0:11675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123138.066403:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381230976 00000100:00100000:0.0:1789123138.066406:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381230976 00000100:00100000:0.0:1789123138.066422:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789123138.066428:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:11675:x1876031381230976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789123138.066562:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:11675:x1876031381230976:12345-0@lo:502:llog_process_th.0 Request processed in 134us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123138.066569:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789123138.066594:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340679ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789123138.066605:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:11675:1876031381230976:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789123138.066642:0:11675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789123138.066660:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789123138.066662:0:11675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789123138.066669:0:11675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f343be04000 00000020:00000080:0.0:1789123138.066671:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789123138.066726:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:11675:1876031381231104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789123138.066756:0:11675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123138.066773:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381231104 00000100:00100000:0.0:1789123138.066776:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381231104 00000100:00100000:0.0:1789123138.066791:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789123138.066797:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:11675:x1876031381231104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789123138.066894:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:11675:x1876031381231104:12345-0@lo:502:llog_process_th.0 Request processed in 97us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123138.066900:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789123138.066927:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340679ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789123138.066938:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:11675:1876031381231104:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789123138.066956:0:11675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789123138.066960:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789123138.066961:0:11675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:0.0:1789123138.066965:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789123138.067007:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789123138.067033:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789123138.067043:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91c15 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91c1c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123138.067053:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91c15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91c1c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789123138.067063:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789123138.067065:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f3408401800 from 7 10000000:01000000:0.0:1789123138.067068:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789123138.067089:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3435b53c00/0x7e1648d68fc91c23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123138.067097:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f3435b53c00/0x7e1648d68fc91c23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123138.067106:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f3435b53c00/0x7e1648d68fc91c23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123138.067119:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381231232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789123138.067144:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123138.067157:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340679ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789123138.067167:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381231232 00000100:00100000:0.0:1789123138.067171:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381231232 00000100:00100000:0.0:1789123138.067188:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789123138.067193:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381231232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789123138.067200:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123138.067211:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3435b52400/0x7e1648d68fc91c2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91c23 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123138.067240:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3435b52400/0x7e1648d68fc91c2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91c23 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123138.067249:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3435b52400/0x7e1648d68fc91c2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91c23 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123138.067258:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b52400, rc 0) 00000100:00100000:0.0:1789123138.067289:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:5838:x1876031381231232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123138.067295:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789123138.067320:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381231232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789123138.067332:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f3435b53c00/0x7e1648d68fc91c23 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91c2a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123138.067341:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f3435b53c00/0x7e1648d68fc91c23 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91c2a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123138.067380:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381231360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789123138.067401:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123138.067413:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340679ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789123138.067423:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381231360 00000100:00100000:0.0:1789123138.067426:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381231360 00000100:00100000:0.0:1789123138.067441:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789123138.067446:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:5838:x1876031381231360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789123138.067611:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:5838:x1876031381231360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123138.067646:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789123138.067688:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381231360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789123138.067709:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381231488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789123138.067739:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123138.067752:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340679ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789123138.067763:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381231488 00000100:00100000:0.0:1789123138.067766:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381231488 00000100:00100000:0.0:1789123138.067781:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789123138.067786:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:5838:x1876031381231488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789123138.067896:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:5838:x1876031381231488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123138.067902:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789123138.067934:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381231488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789123138.074994:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f341848b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:11676:1876031381231616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789123138.075080:0:11676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123138.075133:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f342d7349c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789123138.075183:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381231616 00000100:00100000:0.0:1789123138.075189:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381231616 00000100:00100000:0.0:1789123138.075232:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789123138.075242:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:11676:x1876031381231616:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789123138.075440:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:11676:x1876031381231616:12345-0@lo:502:llog_process_th.0 Request processed in 199us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123138.075447:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789123138.075618:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f341848b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:11676:1876031381231616:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789123138.075683:0:11676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789123138.075691:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123138.075693:0:11676:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789123138.075699:0:11676:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f3408401800 00000020:00000080:3.0:1789123138.075702:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789123138.075770:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f340665c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:11676:1876031381231744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789123138.075802:0:11676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123138.075819:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340e066cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789123138.076241:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381231744 00000100:00100000:0.0:1789123138.076247:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381231744 00000100:00100000:0.0:1789123138.076280:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789123138.076287:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:11676:x1876031381231744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789123138.076449:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:11676:x1876031381231744:12345-0@lo:502:llog_process_th.0 Request processed in 161us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123138.076468:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789123138.076669:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f340665c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:11676:1876031381231744:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789123138.076694:0:11676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789123138.076700:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123138.076702:0:11676:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:3.0:1789123138.076706:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789123138.077248:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789123138.077269:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789123138.077279:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3435b53c00/0x7e1648d68fc91c23 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91c2a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123138.077289:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f3435b53c00/0x7e1648d68fc91c23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91c2a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123138.140778:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123138.140851:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364415744 00000100:00100000:0.0:1789123138.140863:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364415744 00000100:00100000:0.0:1789123138.140912:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 261 00000100:00100000:0.0:1789123138.140924:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+11:5592:x1876031364415744:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789123138.140940:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123138.140959:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3435b53200/0x7e1648d68fc91c31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f4fc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123138.140989:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3435b53200/0x7e1648d68fc91c31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4fc expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123138.141002:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3435b53200/0x7e1648d68fc91c31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4fc expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123138.141011:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53200, rc 0) 00000100:00100000:0.0:1789123138.141073:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+12:5592:x1876031364415744:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 Request processed in 151us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123138.141093:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 261 00000100:00100000:3.0:1789123138.144371:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123138.144581:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364415872 00000100:00100000:1.0:1789123138.144590:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364415872 00000100:00100000:1.0:1789123138.144674:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 262 00000100:00100000:1.0:1789123138.144684:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+12:5592:x1876031364415872:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789123138.145173:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+12:5592:x1876031364415872:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 Request processed in 488us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123138.145182:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 262 00000100:00100000:0.0:1789123138.152532:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123138.152600:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364416000 00000100:00100000:2.0:1789123138.152610:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364416000 00000100:00100000:2.0:1789123138.152700:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 263 00000100:00100000:2.0:1789123138.152710:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+12:5592:x1876031364416000:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789123138.152927:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+12:5592:x1876031364416000:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 Request processed in 219us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123138.152936:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 263 00000100:00100000:3.0:1789123138.163915:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123138.164011:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364416128 00000100:00100000:1.0:1789123138.164021:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364416128 00000100:00100000:1.0:1789123138.164070:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 264 00000100:00100000:1.0:1789123138.164080:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+12:9526:x1876031364416128:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789123138.164311:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+12:9526:x1876031364416128:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 232us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123138.164320:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 264 00000100:00100000:0.0:1789123138.180855:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123138.181128:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364416256 00000100:00100000:2.0:1789123138.181151:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364416256 00000100:00100000:2.0:1789123138.181205:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 265 00000100:00100000:2.0:1789123138.181215:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+12:9526:x1876031364416256:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789123138.181804:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+12:9526:x1876031364416256:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 587us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123138.181813:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 265 00000100:00100000:0.0:1789123138.209047:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123138.210006:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364416384 00000100:00100000:1.0:1789123138.210019:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364416384 00000100:00100000:1.0:1789123138.210083:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 266 00000100:00100000:1.0:1789123138.210095:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+12:5592:x1876031364416384:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789123138.210112:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123138.210130:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f343bd32800/0x7e1648d68fc91c38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f503 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123138.210161:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f343bd32800/0x7e1648d68fc91c38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f503 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123138.210172:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f343bd32800/0x7e1648d68fc91c38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f503 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123138.210196:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd32800, rc 0) 00000100:00100000:1.0:1789123138.210269:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+13:5592:x1876031364416384:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 Request processed in 176us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123138.210277:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 266 00000100:00100000:3.0:1789123138.218987:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123138.219114:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364416512 00000100:00100000:2.0:1789123138.219127:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364416512 00000100:00100000:2.0:1789123138.219191:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 267 00000100:00100000:2.0:1789123138.219202:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+13:5592:x1876031364416512:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789123138.219605:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+13:5592:x1876031364416512:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 Request processed in 404us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123138.219613:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 267 00000100:00100000:2.0:1789123138.227217:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123138.227368:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364416640 00000100:00100000:0.0:1789123138.227378:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364416640 00000100:00100000:0.0:1789123138.227429:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 268 00000100:00100000:0.0:1789123138.227439:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+13:5592:x1876031364416640:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789123138.227845:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+13:5592:x1876031364416640:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 Request processed in 404us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123138.227854:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 268 00000100:00100000:0.0:1789123138.248241:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123138.250441:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364416768 00000100:00100000:1.0:1789123138.250458:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364416768 00000100:00100000:1.0:1789123138.250588:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 269 00000100:00100000:1.0:1789123138.250599:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+13:9529:x1876031364416768:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789123138.250931:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+13:9529:x1876031364416768:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 333us (3055us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123138.250939:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 269 00000100:00100000:3.0:1789123138.254590:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123138.271933:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364416896 00000100:00100000:2.0:1789123138.271947:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364416896 00000100:00100000:2.0:1789123138.272007:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 270 00000100:00100000:2.0:1789123138.272017:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+13:9529:x1876031364416896:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789123138.272333:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+13:9529:x1876031364416896:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 317us (17751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123138.272342:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 270 00010000:00010000:1.0:1789123139.077967:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123139.588941:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789123139.589204:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381232000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789123139.589274:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123139.589334:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f341848b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381231872:0@lo:400:kworker.0 00000100:00100000:2.0:1789123139.589363:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123139.589388:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789123139.589393:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34063b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381232384:0@lo:400:kworker.0 00000100:00100000:2.0:1789123139.589424:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123139.589460:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f341848a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381232128:0@lo:400:kworker.0 00000100:00100000:2.0:1789123139.589495:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123139.589514:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789123139.589520:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381232256:0@lo:400:kworker.0 00000100:00100000:2.0:1789123139.589543:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123139.589580:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381232000 00000100:00100000:2.0:1789123139.589587:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381232000 00000100:00100000:2.0:1789123139.589688:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789123139.589698:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435673c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381232000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789123139.589735:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123139.589775:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435673c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381232000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123139.589794:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789123139.589820:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381231872 00000100:00100000:2.0:1789123139.589824:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381231872 00000100:00100000:2.0:1789123139.589851:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789123139.589859:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3305:x1876031381231872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123139.589887:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3305:x1876031381231872:12345-0@lo:400:kworker.0 Request processed in 30us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123139.589894:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789123139.589919:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381232384 00000100:00100000:2.0:1789123139.589933:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381232384 00000100:00100000:2.0:1789123139.589963:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789123139.589970:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435671680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381232384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123139.590003:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435671680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381232384:12345-0@lo:400:kworker.0 Request processed in 35us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123139.590009:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789123139.590026:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381232128 00000100:00100000:2.0:1789123139.590030:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381232128 00000100:00100000:2.0:1789123139.590051:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381232256 00000100:00100000:2.0:1789123139.590055:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381232256 00000100:00100000:2.0:1789123139.590073:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789123139.590079:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435672580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381232128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123139.590122:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435672580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381232128:12345-0@lo:400:kworker.0 Request processed in 44us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123139.590129:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789123139.590142:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789123139.590149:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381232256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123139.590200:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381232256:12345-0@lo:400:kworker.0 Request processed in 51us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123139.590210:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:2.0:1789123139.590231:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789123139.590238:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789123139.590240:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789123139.590281:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381232256:0@lo:400:kworker.0 00000100:00100000:2.0:1789123139.590294:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f341848a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381232128:0@lo:400:kworker.0 00010000:00080000:2.0:1789123139.590322:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34063b6940 x1876031381232384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123139.590333:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34063b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381232384:0@lo:400:kworker.0 00010000:00080000:2.0:1789123139.590342:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34365cfc00 x1876031381232000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123155 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123139.590353:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381232000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789123139.590362:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f341848b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381231872:0@lo:400:kworker.0 00000100:00100000:0.0:1789123139.596879:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789123139.596900:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34063b6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876031381232512:0@lo:400:kworker.0 00000100:00100000:0.0:1789123139.596966:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123139.597053:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381232512 00000100:00100000:1.0:1789123139.597062:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381232512 00000100:00100000:1.0:1789123139.597122:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789123139.597132:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876031381232512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123139.597196:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876031381232512:12345-0@lo:400:kworker.0 Request processed in 66us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123139.597204:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:0.0:1789123139.597305:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789123139.597343:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34063b6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876031381232512:0@lo:400:kworker.0 00010000:00010000:3.0:1789123140.101700:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123141.126901:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123141.128745:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34063b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381232640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789123141.128842:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123141.128944:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381232640 00000100:00100000:1.0:1789123141.128953:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381232640 00000100:00100000:0.0:1789123141.130249:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1789123141.130262:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789123141.130265:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381232640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789123141.130317:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789123141.130408:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381232640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (1564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123141.130416:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1789123141.131280:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34063b4f00 x1876031381232640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123141.131324:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34063b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381232640:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789123142.149857:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123142.555497:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123142.555554:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123142.555603:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123142.555669:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364417280 00000100:00100000:0.0:1789123142.555681:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364417280 00000100:00100000:0.0:1789123142.555746:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364417152 00000100:00100000:0.0:1789123142.555748:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364417152 00000100:00100000:0.0:1789123142.555789:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 101 00000100:00100000:0.0:1789123142.555801:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2352:x1876031364417280:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123142.555913:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2352:x1876031364417280:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 113us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123142.555923:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 101 00000100:00100000:0.0:1789123142.555943:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 102 00000100:00100000:0.0:1789123142.555949:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2352:x1876031364417152:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123142.555971:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2352:x1876031364417152:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 22us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123142.555977:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 102 00000100:00080000:0.0:1789123142.555994:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789123142.556588:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364417024 00000100:00100000:2.0:1789123142.556598:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364417024 00000100:00100000:2.0:1789123142.556676:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 272 00000100:00100000:2.0:1789123142.556687:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+13:2352:x1876031364417024:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1789123142.556735:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+13:2352:x1876031364417024:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 52us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123142.556742:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 272 00000001:02000400:1.0:1789123142.676004:0:11815:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 06:39:01 (1789123141) === 00010000:00010000:1.0:1789123143.173049:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123144.197757:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123144.469435:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123144.469500:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123144.469567:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364417408 00000100:00100000:1.0:1789123144.469583:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364417408 00000100:00100000:3.0:1789123144.469592:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364417536 00000100:00100000:3.0:1789123144.469596:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364417536 00000100:00100000:3.0:1789123144.469689:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 0 00000100:00100000:1.0:1789123144.469689:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 14 00000100:00100000:3.0:1789123144.469701:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:64de9449-4320-4c9f-abcb-230edd2b11ae+7:9896:x1876031364417536:12345-192.168.206.30@tcp:700:mkdir.0 00000100:00100000:1.0:1789123144.469701:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2352:x1876031364417408:12345-192.168.206.30@tcp:41:mkdir.0 00000004:00000024:1.0:1789123144.469753:0:7640:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789123144.469801:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:64de9449-4320-4c9f-abcb-230edd2b11ae+7:9896:x1876031364417536:12345-192.168.206.30@tcp:700:mkdir.0 Request processed in 103us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123144.469808:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2352:x1876031364417408:12345-192.168.206.30@tcp:41:mkdir.0 Request processed in 112us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123144.469809:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 0 00000100:00100000:1.0:1789123144.469814:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 14 00000100:00080000:0.0:1789123144.470078:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789123144.481028:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123144.481461:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364417792 00000100:00100000:2.0:1789123144.481476:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364417792 00000100:00100000:2.0:1789123144.481735:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 15 00000100:00100000:2.0:1789123144.481749:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+6:9896:x1876031364417792:12345-192.168.206.30@tcp:36:mkdir.0 00010000:00010000:2.0:1789123144.481830:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123144.485861:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3400030400/0x7e1648d68fc91ae1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f477 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123144.485892:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34226c1d00) 00010000:00010000:2.0:1789123144.485923:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789123144.486289:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91c3f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123144.486302:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91c3f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123144.486313:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91c3f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123144.486344:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc91c46 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123144.486351:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc91c46 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123144.486357:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc91c46 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123144.490161:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1789123144.490179:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91c3f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123144.490198:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91c3f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123144.490205:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91c3f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123144.490211:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123144.490215:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91c3f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123144.490221:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91c3f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123144.490237:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34232f7900) 00010000:00010000:2.0:1789123144.490240:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123144.490244:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91c3f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123144.490250:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91c3f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789123144.490268:0:5841:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002f142cc8 reply state 000000005b15490f transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc91c46 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123144.490276:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789123144.490460:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+7:9896:x1876031364417792:12345-192.168.206.30@tcp:36:mkdir.0 Request processed in 8710us (9447us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789123144.490469:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 15 00010000:00010000:0.0:1789123144.516883:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc91c46 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.516909:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc91c46 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.516920:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc91c46 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.516949:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a800 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123144.516955:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc91c46 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.516964:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc91c46 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.516987:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f34232f7400) 00010000:00010000:0.0:1789123144.516991:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123144.516997:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc91c46 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.517005:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc91c46 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123144.560387:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123144.560904:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364417920 00000100:00100000:1.0:1789123144.560919:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364417920 00000100:00100000:1.0:1789123144.561008:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 16 00000100:00100000:1.0:1789123144.561021:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+6:9897:x1876031364417920:12345-192.168.206.30@tcp:101:chmod.0 00010000:00010000:1.0:1789123144.561054:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123144.561086:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc91c4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f50a expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123144.561184:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc91c54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123144.561202:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc91c54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123144.561218:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc91c54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123144.561312:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1789123144.561316:0:7640:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1789123144.561504:0:7640:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc91c54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123144.561540:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc91c4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f50a expref: 8 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123144.561563:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc91c54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f50a expref: 7 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123144.561574:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f340534d700) 00010000:00010000:1.0:1789123144.561577:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789123144.561581:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd32200, rc 0) 00000100:00100000:1.0:1789123144.561708:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+7:9897:x1876031364417920:12345-192.168.206.30@tcp:101:chmod.0 Request processed in 689us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123144.561715:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 16 00000100:00100000:1.0:1789123144.575382:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123144.577679:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364418176 00000100:00100000:3.0:1789123144.577697:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364418176 00000100:00100000:3.0:1789123144.577773:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 17 00000100:00100000:3.0:1789123144.577799:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+7:9897:x1876031364418176:12345-192.168.206.30@tcp:36:chmod.0 00010000:00010000:3.0:1789123144.577859:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123144.577891:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc91c54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f50a expref: 7 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.577912:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f340534d700) 00010000:00010000:3.0:1789123144.577923:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789123144.577948:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91c5b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.577962:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91c5b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.577972:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91c5b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789123144.578326:0:5840:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000000d705769 reply state 0000000018a37e52 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91c5b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123144.578337:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789123144.578353:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1789123144.578441:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+8:9897:x1876031364418176:12345-192.168.206.30@tcp:36:chmod.0 Request processed in 645us (3072us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789123144.578449:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 17 00010000:00010000:3.0:1789123144.589124:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91c5b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.589160:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91c5b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.589167:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91c5b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.589172:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34029f3200 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123144.589177:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91c5b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.589184:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91c5b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.589199:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f3411751000) 00010000:00010000:3.0:1789123144.589202:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789123144.589207:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91c5b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.589213:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91c5b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123144.642164:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123144.642311:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364418304 00000100:00100000:0.0:1789123144.642326:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364418304 00000100:00100000:0.0:1789123144.642425:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 18 00000100:00100000:0.0:1789123144.642441:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+7:9898:x1876031364418304:12345-192.168.206.30@tcp:101:chown.0 00010000:00010000:0.0:1789123144.642480:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123144.642523:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc91c62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f511 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.642692:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52000/0x7e1648d68fc91c69 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.642712:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52000/0x7e1648d68fc91c69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.642751:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52000/0x7e1648d68fc91c69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123144.642836:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1789123144.642841:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1789123144.642909:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52000/0x7e1648d68fc91c69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.642943:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc91c62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f511 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.642967:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52000/0x7e1648d68fc91c69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f511 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.642976:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34226c1100) 00010000:00010000:0.0:1789123144.642979:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789123144.642984:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b52000, rc 0) 00000100:00100000:0.0:1789123144.643075:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+8:9898:x1876031364418304:12345-192.168.206.30@tcp:101:chown.0 Request processed in 637us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123144.643084:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 18 00000100:00100000:0.0:1789123144.656965:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123144.657138:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364418432 00000100:00100000:3.0:1789123144.657153:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364418432 00000100:00100000:3.0:1789123144.657293:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 19 00000100:00100000:3.0:1789123144.657306:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+8:9898:x1876031364418432:12345-192.168.206.30@tcp:101:chown.0 00010000:00010000:3.0:1789123144.657346:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123144.657375:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91c70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f518 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.657482:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2a00/0x7e1648d68fc91c77 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.657531:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2a00/0x7e1648d68fc91c77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.657546:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2a00/0x7e1648d68fc91c77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.657567:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2600/0x7e1648d68fc91c7e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.657575:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2600/0x7e1648d68fc91c7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.657582:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2600/0x7e1648d68fc91c7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.657948:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3600/0x7e1648d68fc91c85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.657957:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3600/0x7e1648d68fc91c85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.657965:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3600/0x7e1648d68fc91c85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123144.658021:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1789123144.658026:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789123144.658062:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3600/0x7e1648d68fc91c85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.658076:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2a00/0x7e1648d68fc91c77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.658096:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2a00/0x7e1648d68fc91c77 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.658104:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2a00/0x7e1648d68fc91c77 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.658111:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34029f2a00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123144.658117:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2a00/0x7e1648d68fc91c77 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.658125:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2a00/0x7e1648d68fc91c77 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.658139:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34226c1100) 00010000:00010000:3.0:1789123144.658142:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123144.658147:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2a00/0x7e1648d68fc91c77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.658154:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2a00/0x7e1648d68fc91c77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.658172:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2600/0x7e1648d68fc91c7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.658178:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2600/0x7e1648d68fc91c7e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.658184:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2600/0x7e1648d68fc91c7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.658190:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34029f2600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123144.658199:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2600/0x7e1648d68fc91c7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.658206:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2600/0x7e1648d68fc91c7e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.658214:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f3411751000) 00010000:00010000:3.0:1789123144.658217:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123144.658220:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2600/0x7e1648d68fc91c7e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.658226:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2600/0x7e1648d68fc91c7e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.658271:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91c70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f518 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.658291:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3600/0x7e1648d68fc91c85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f518 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.658300:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f3411751f00) 00010000:00010000:3.0:1789123144.658302:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789123144.658305:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f34029f3600, rc 0) 00000100:00100000:3.0:1789123144.658409:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+9:9898:x1876031364418432:12345-192.168.206.30@tcp:101:chown.0 Request processed in 1105us (2549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123144.659613:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 19 00000100:00100000:2.0:1789123144.662926:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123144.663042:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364418688 00000100:00100000:0.0:1789123144.663055:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364418688 00000100:00100000:0.0:1789123144.663135:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 20 00000100:00100000:0.0:1789123144.663147:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435671a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+9:9898:x1876031364418688:12345-192.168.206.30@tcp:36:chown.0 00010000:00010000:0.0:1789123144.663215:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123144.663252:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3600/0x7e1648d68fc91c85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f518 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.663575:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f3411751f00) 00010000:00010000:0.0:1789123144.663591:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789123144.663670:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc91c8c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.663688:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc91c8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.663700:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc91c8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123144.711342:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789123144.711377:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381232768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789123144.711807:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123144.716864:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381233152:0@lo:400:kworker.0 00000100:00100000:0.0:1789123144.716970:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123144.717031:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789123144.717039:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381233280:0@lo:400:kworker.0 00000100:00100000:0.0:1789123144.717071:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123144.718226:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876031381233024:0@lo:400:kworker.0 00000100:00100000:3.0:1789123144.718318:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123144.718363:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789123144.718391:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381232896:0@lo:400:kworker.0 00000100:00100000:3.0:1789123144.718445:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123144.718498:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381233408:0@lo:400:kworker.0 00000100:00100000:3.0:1789123144.718534:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123144.718849:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381233152 00000100:00100000:3.0:1789123144.718859:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381233152 00000100:00100000:3.0:1789123144.718919:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381233024 00000100:00100000:3.0:1789123144.718923:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381233024 00000100:00100000:3.0:1789123144.718939:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381233408 00000100:00100000:3.0:1789123144.718942:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381233408 00000100:00100000:3.0:1789123144.718960:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789123144.718970:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381233152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123144.719040:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381233152:12345-0@lo:400:kworker.0 Request processed in 71us (2071us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123144.719048:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789123144.719067:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789123144.719073:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876031381233024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123144.719108:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876031381233024:12345-0@lo:400:kworker.0 Request processed in 35us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123144.719114:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789123144.719125:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789123144.719131:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876031381233408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123144.719162:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876031381233408:12345-0@lo:400:kworker.0 Request processed in 31us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123144.719168:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1789123144.719191:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789123144.719240:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381233408:0@lo:400:kworker.0 00000100:00100000:3.0:1789123144.719267:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876031381233024:0@lo:400:kworker.0 00000100:00100000:3.0:1789123144.719313:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381233152:0@lo:400:kworker.0 00000100:00100000:2.0:1789123144.721284:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381232768 00000100:00100000:2.0:1789123144.721326:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381232768 00000100:00100000:2.0:1789123144.721373:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381233280 00000100:00100000:2.0:1789123144.721379:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381233280 00000100:00100000:2.0:1789123144.721484:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789123144.721507:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381233280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123144.721688:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381233280:12345-0@lo:400:kworker.0 Request processed in 183us (4614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123144.721697:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789123144.721728:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381232896 00000100:00100000:2.0:1789123144.721732:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381232896 00000100:00100000:2.0:1789123144.721761:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789123144.721767:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3305:x1876031381232896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123144.721810:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3305:x1876031381232896:12345-0@lo:400:kworker.0 Request processed in 43us (3364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123144.721816:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789123144.721888:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381232896:0@lo:400:kworker.0 00010000:00080000:2.0:1789123144.721945:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34365ccb40 x1876031381233280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123144.721959:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381233280:0@lo:400:kworker.0 00000100:00100000:2.0:1789123144.722020:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789123144.722030:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365cde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381232768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789123144.722068:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123144.722111:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365cde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381232768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (10305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123144.722117:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1789123144.722154:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34365ccf00 x1876031381232768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123144.722182:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381232768:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789123144.722415:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789123144.722421:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789123144.748591:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1789123144.748761:0:5842:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f50b5c2a reply state 000000007091b035 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc91c8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123144.748778:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789123144.749008:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:0.0:1789123144.749158:0:5842:0:(ldlm_lib.c:3520:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789123144.749187:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435671a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+7:9898:x1876031364418688:12345-192.168.206.30@tcp:36:chown.0 Request processed in 86036us (86268us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789123144.749198:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 20 00010000:00010000:1.0:1789123144.749948:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc91c8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123144.749966:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc91c8c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123144.749975:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc91c8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123144.749993:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53e00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123144.750000:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc91c8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123144.750009:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc91c8c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123144.750037:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f34226c1500) 00010000:00010000:1.0:1789123144.750040:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789123144.750048:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc91c8c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123144.750055:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc91c8c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123144.778464:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123144.779130:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364418816 00000100:00100000:3.0:1789123144.779146:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364418816 00000100:00100000:3.0:1789123144.779239:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 21 00000100:00100000:3.0:1789123144.779252:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435672940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+6:9900:x1876031364418816:12345-192.168.206.30@tcp:101:touch.500 00010000:00010000:3.0:1789123144.779302:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123144.779331:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91c93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f51f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789123144.782686:0:5840:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3280us 00010000:00010000:0.0:1789123144.808743:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc91c9a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.808775:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc91c9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.808789:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc91c9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.808810:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52e00/0x7e1648d68fc91ca1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.808818:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52e00/0x7e1648d68fc91ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.808825:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52e00/0x7e1648d68fc91ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.809386:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc91ca8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.809396:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc91ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.809404:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc91ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123144.809493:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789123144.809498:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789123144.809668:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc91ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.809686:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc91c9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.809701:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc91c9a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.809708:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc91c9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.809715:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52800 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123144.809720:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc91c9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.809730:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc91c9a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.809747:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34226c1100) 00010000:00010000:0.0:1789123144.809750:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123144.809755:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc91c9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.809762:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc91c9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.809776:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52e00/0x7e1648d68fc91ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.809782:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52e00/0x7e1648d68fc91ca1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.809787:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52e00/0x7e1648d68fc91ca1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.809792:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52e00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123144.809802:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52e00/0x7e1648d68fc91ca1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.809808:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52e00/0x7e1648d68fc91ca1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.809816:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f34226c1900) 00010000:00010000:0.0:1789123144.809819:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123144.809823:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52e00/0x7e1648d68fc91ca1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.809829:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52e00/0x7e1648d68fc91ca1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.809878:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91c93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f51f expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.809898:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc91ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f51f expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.809906:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f34226c1a00) 00010000:00010000:0.0:1789123144.809909:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789123144.809911:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b52c00, rc 0) 00000100:00100000:0.0:1789123144.810020:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435672940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+7:9900:x1876031364418816:12345-192.168.206.30@tcp:101:touch.500 Request processed in 30769us (31570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123144.810032:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 21 00000100:00100000:1.0:1789123144.814794:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123144.816818:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364419072 00000100:00100000:2.0:1789123144.816842:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364419072 00000100:00100000:2.0:1789123144.816949:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 22 00000100:00100000:2.0:1789123144.816962:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+7:9900:x1876031364419072:12345-192.168.206.30@tcp:101:touch.500 00010000:00010000:2.0:1789123144.816988:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123144.817017:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91caf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f526 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123144.817420:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b800/0x7e1648d68fc91cb6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123144.817439:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b800/0x7e1648d68fc91cb6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123144.817454:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b800/0x7e1648d68fc91cb6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123144.817471:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc91cbd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123144.817479:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc91cbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123144.817485:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc91cbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789123144.819406:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1789123144.821935:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2600/0x7e1648d68fc91cc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.821971:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2600/0x7e1648d68fc91cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.821989:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2600/0x7e1648d68fc91cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.822077:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b800/0x7e1648d68fc91cb6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.822085:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b800/0x7e1648d68fc91cb6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.822118:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b800/0x7e1648d68fc91cb6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.822126:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80b800 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123144.822131:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b800/0x7e1648d68fc91cb6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.822141:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b800/0x7e1648d68fc91cb6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.822157:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f34226c1a00) 00010000:00010000:3.0:1789123144.822161:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123144.822167:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b800/0x7e1648d68fc91cb6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.822175:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b800/0x7e1648d68fc91cb6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789123144.822192:0:5841:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000509a27de reply state 000000002bf6d998 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc91cbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123144.822204:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789123144.822272:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91caf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f526 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.822292:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2600/0x7e1648d68fc91cc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f526 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.822300:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9f3411751000) 00010000:00010000:3.0:1789123144.822303:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789123144.822313:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f34029f2600, rc 0) 00000100:00100000:3.0:1789123144.822429:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+10:9900:x1876031364419072:12345-192.168.206.30@tcp:101:touch.500 Request processed in 5469us (7647us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789123144.822440:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 22 00010000:00010000:3.0:1789123144.824310:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc91cbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.824334:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc91cbd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.824343:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc91cbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.824352:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80bc00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123144.824357:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc91cbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.824367:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc91cbd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.824387:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xfd685d83 (ffff9f34232f7600) 00010000:00010000:3.0:1789123144.824391:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123144.824396:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc91cbd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.824402:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc91cbd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123144.830967:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123144.831169:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364419328 00000100:00100000:3.0:1789123144.831183:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364419328 00000100:00100000:3.0:1789123144.831264:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 23 00000100:00100000:3.0:1789123144.831276:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+9:9900:x1876031364419328:12345-192.168.206.30@tcp:36:touch.500 00010000:00010000:3.0:1789123144.831375:0:7640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123144.831412:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2600/0x7e1648d68fc91cc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f526 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.831438:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9f3411751000) 00010000:00010000:3.0:1789123144.831452:0:7640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789123144.831524:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2a00/0x7e1648d68fc91cd2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.832058:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2a00/0x7e1648d68fc91cd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.832072:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2a00/0x7e1648d68fc91cd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789123144.832257:0:7640:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000bd57b2dd reply state 00000000e0e190a2 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2a00/0x7e1648d68fc91cd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123144.832268:0:7640:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789123144.832411:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+10:9900:x1876031364419328:12345-192.168.206.30@tcp:36:touch.500 Request processed in 1134us (1455us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789123144.832419:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 23 00000100:00100000:2.0:1789123144.835236:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00010000:00010000:1.0:1789123144.835314:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2a00/0x7e1648d68fc91cd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123144.835329:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2a00/0x7e1648d68fc91cd2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123144.835338:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2a00/0x7e1648d68fc91cd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123144.835346:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34029f2a00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123144.835352:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2a00/0x7e1648d68fc91cd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123144.835362:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2a00/0x7e1648d68fc91cd2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123144.835394:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9f3411751c00) 00010000:00010000:1.0:1789123144.835397:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123144.835405:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2a00/0x7e1648d68fc91cd2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123144.835412:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2a00/0x7e1648d68fc91cd2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123144.837903:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364419456 00000100:00100000:0.0:1789123144.837927:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364419456 00000100:00100000:0.0:1789123144.838388:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 24 00000100:00100000:0.0:1789123144.838404:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435673840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+9:9900:x1876031364419456:12345-192.168.206.30@tcp:101:touch.500 00010000:00010000:0.0:1789123144.838464:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123144.838502:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52e00/0x7e1648d68fc91cd9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f52d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.838706:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52e00/0x7e1648d68fc91cd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f52d expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.838725:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52e00/0x7e1648d68fc91cd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f52d expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.838750:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9f34226c1900) 00010000:00010000:0.0:1789123144.838754:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789123144.838758:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b52e00, rc 0) 00000100:00100000:0.0:1789123144.838864:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435673840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+10:9900:x1876031364419456:12345-192.168.206.30@tcp:101:touch.500 Request processed in 464us (3640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123144.838873:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 24 00000100:00100000:2.0:1789123144.844965:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123144.848103:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364419584 00000100:00100000:1.0:1789123144.848135:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364419584 00000100:00100000:1.0:1789123144.848224:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 16 00000100:00100000:1.0:1789123144.848235:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34356730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1876031364419584:12345-192.168.206.30@tcp:8:touch.500 00010000:00080000:1.0:1789123144.848282:0:6687:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 64de9449-4320-4c9f-abcb-230edd2b11ae@192.168.206.30@tcp t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:1.0:1789123144.848359:0:6687:0:(genops.c:1385:class_connect()) connect: client 64de9449-4320-4c9f-abcb-230edd2b11ae, cookie 0x7e1648d68fc91ce0 00002000:00100000:1.0:1789123144.848380:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 64de9449-4320-4c9f-abcb-230edd2b11ae/ffff9f34184d8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398a ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789123144.848400:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789123144.848774:0:6687:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789123144.848820:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9f34184dc800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789123144.848921:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34356730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2351:x1876031364419584:12345-192.168.206.30@tcp:8:touch.500 Request processed in 686us (3972us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123144.848932:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 16 00000100:00100000:1.0:1789123144.856545:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123144.856847:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364419712 00000100:00100000:2.0:1789123144.856861:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364419712 00000100:00100000:2.0:1789123144.856972:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 17 00000100:00100000:2.0:1789123144.856985:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+6:0:x1876031364419712:12345-192.168.206.30@tcp:2:touch.500 00000100:00080000:1.0:1789123144.857549:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1789123144.942415:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 64de9449-4320-4c9f-abcb-230edd2b11ae 00000001:00080000:1.0:1789123144.942442:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:0.0:1789123144.942823:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+5:0:x1876031364419712:12345-192.168.206.30@tcp:2:touch.500 Request processed in 85832us (86292us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789123144.942837:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 17 00000100:00100000:2.0:1789123144.946201:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123144.946486:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364419968 00000100:00100000:3.0:1789123144.946500:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364419968 00000100:00100000:3.0:1789123144.946587:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 2 00000100:00100000:3.0:1789123144.946600:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f341848b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+10:9900:x1876031364419968:12345-192.168.206.30@tcp:35:touch.500 00000100:00100000:3.0:1789123144.947283:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f341848b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+11:9900:x1876031364419968:12345-192.168.206.30@tcp:35:touch.500 Request processed in 681us (1094us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789123144.947320:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 2 00000100:00100000:1.0:1789123144.963506:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123144.963802:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364420096 00000100:00100000:0.0:1789123144.963816:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364420096 00000100:00100000:0.0:1789123144.964025:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 25 00000100:00100000:0.0:1789123144.964039:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+11:9901:x1876031364420096:12345-192.168.206.30@tcp:101:rm.0 00010000:00010000:0.0:1789123144.964085:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123144.964114:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc91ce7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f534 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.964224:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc91cee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.964241:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc91cee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.964256:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc91cee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123144.964337:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789123144.964341:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789123144.964401:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc91cee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.964433:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc91ce7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f534 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.964453:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc91cee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f534 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123144.964462:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f34226c1a00) 00010000:00010000:0.0:1789123144.964466:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789123144.964470:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53600, rc 0) 00000100:00100000:0.0:1789123144.964880:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+12:9901:x1876031364420096:12345-192.168.206.30@tcp:101:rm.0 Request processed in 841us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123144.964889:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 25 00000100:00100000:1.0:1789123144.972129:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123144.972230:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364420352 00000100:00100000:3.0:1789123144.972247:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364420352 00000100:00100000:3.0:1789123144.972331:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 26 00000100:00100000:3.0:1789123144.972344:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407d3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+12:9901:x1876031364420352:12345-192.168.206.30@tcp:101:rm.0 00010000:00010000:3.0:1789123144.972378:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123144.972406:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2600/0x7e1648d68fc91cf5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f53b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123144.973291:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1789123144.974274:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2600/0x7e1648d68fc91cf5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f53b expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.974297:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34226c1100) 00010000:00010000:3.0:1789123144.974301:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789123144.974307:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2600/0x7e1648d68fc91cf5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f53b expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.974328:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f34029f2600, rc 0) 00000100:00100000:3.0:1789123144.974471:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407d3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+13:9901:x1876031364420352:12345-192.168.206.30@tcp:101:rm.0 Request processed in 2128us (2356us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1789123144.974482:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 26 00000100:00100000:0.0:1789123144.979888:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123144.980053:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364420480 00000100:00100000:3.0:1789123144.980068:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364420480 00000100:00100000:3.0:1789123144.980143:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 3 00000100:00100000:3.0:1789123144.980155:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+13:9901:x1876031364420480:12345-192.168.206.30@tcp:37:rm.0 00000100:00100000:2.0:1789123144.986923:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+13:9901:x1876031364420480:12345-192.168.206.30@tcp:37:rm.0 Request processed in 6753us (7033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123144.986950:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 3 00000100:00100000:1.0:1789123144.990882:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123144.991052:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364420736 00000100:00100000:0.0:1789123144.991171:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364420736 00000100:00100000:0.0:1789123144.991284:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 4 00000100:00100000:0.0:1789123144.991296:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427abe850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+13:9901:x1876031364420736:12345-192.168.206.30@tcp:35:rm.0 00000100:00100000:0.0:1789123144.991826:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427abe850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+14:9901:x1876031364420736:12345-192.168.206.30@tcp:35:rm.0 Request processed in 529us (956us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789123144.991836:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 4 00000100:00100000:0.0:1789123144.994408:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123144.994514:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364420992 00000100:00100000:3.0:1789123144.994535:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364420992 00000100:00100000:3.0:1789123144.994677:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 27 00000100:00100000:3.0:1789123144.994690:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+14:9901:x1876031364420992:12345-192.168.206.30@tcp:101:rm.0 00010000:00010000:3.0:1789123144.994726:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123144.994757:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2600/0x7e1648d68fc91d03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f542 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.994922:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2200/0x7e1648d68fc91d0a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.994953:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2200/0x7e1648d68fc91d0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.994967:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2200/0x7e1648d68fc91d0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123144.994982:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1789123144.995222:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2600/0x7e1648d68fc91d03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f542 expref: 17 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.995247:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2200/0x7e1648d68fc91d0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f542 expref: 16 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123144.995257:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f34226c1a00) 00010000:00010000:3.0:1789123144.995260:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789123144.995265:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f34029f2200, rc 0) 00000100:00100000:3.0:1789123144.995339:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+16:9901:x1876031364420992:12345-192.168.206.30@tcp:101:rm.0 Request processed in 650us (943us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789123144.995358:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 27 00000100:00100000:1.0:1789123144.998791:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123144.998915:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364421120 00000100:00100000:0.0:1789123144.998928:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364421120 00000100:00100000:0.0:1789123144.999007:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 28 00000100:00100000:0.0:1789123144.999018:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407d3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+16:9901:x1876031364421120:12345-192.168.206.30@tcp:41:rm.0 00000004:00000024:0.0:1789123144.999121:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1789123144.999218:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407d3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+16:9901:x1876031364421120:12345-192.168.206.30@tcp:41:rm.0 Request processed in 202us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123144.999227:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 28 00000100:00100000:1.0:1789123145.002437:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123145.002557:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364421248 00000100:00100000:0.0:1789123145.002569:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364421248 00000100:00100000:0.0:1789123145.002683:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 29 00000100:00100000:0.0:1789123145.002696:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407d3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+16:9901:x1876031364421248:12345-192.168.206.30@tcp:101:rm.0 00010000:00010000:0.0:1789123145.002722:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123145.002749:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc91d18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f549 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.002841:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc91d1f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.002859:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc91d1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.002894:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc91d1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.002913:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc91d26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.002921:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc91d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.002928:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc91d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.003075:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc91d2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.003084:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc91d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.003092:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc91d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123145.003125:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789123145.003130:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789123145.003152:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc91d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.003166:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc91d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.003176:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc91d1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.003193:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc91d1f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.003200:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc91d1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.003206:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52800 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123145.003211:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc91d1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.003219:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc91d1f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.003233:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f34226c1a00) 00010000:00010000:0.0:1789123145.003236:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123145.003242:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc91d1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.003248:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc91d1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.003263:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc91d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.003269:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc91d26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.003275:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc91d26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.003281:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53e00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123145.003290:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc91d26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.003316:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc91d26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.003324:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xfd685d83 (ffff9f34226c1200) 00010000:00010000:0.0:1789123145.003328:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123145.003330:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc91d26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.003337:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc91d26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.003375:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc91d18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f549 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.003389:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc91d2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f549 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.003396:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9f34226c1900) 00010000:00010000:0.0:1789123145.003398:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789123145.003401:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53800, rc 0) 00000100:00100000:0.0:1789123145.003476:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407d3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+17:9901:x1876031364421248:12345-192.168.206.30@tcp:101:rm.0 Request processed in 783us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123145.003486:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 29 00000100:00100000:2.0:1789123145.007326:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123145.007535:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364421504 00000100:00100000:0.0:1789123145.007550:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364421504 00000100:00100000:0.0:1789123145.007661:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 30 00000100:00100000:0.0:1789123145.007674:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f341848a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+17:9901:x1876031364421504:12345-192.168.206.30@tcp:36:rm.0 00010000:00010000:0.0:1789123145.007779:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789123145.007821:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc91d2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f549 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.007849:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52e00/0x7e1648d68fc91cd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f52d expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.007860:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9f34226c1900) 00010000:00010000:0.0:1789123145.007879:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc91cee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f534 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.007888:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f34226c1a00) 00010000:00010000:0.0:1789123145.007891:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789123145.007918:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc91d34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.008108:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc91d34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.008121:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc91d34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.008141:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc91d3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.008148:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc91d3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.008154:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc91d3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.008366:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc91d42 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.008375:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc91d42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.008382:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc91d42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789123145.010308:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1789123145.010333:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 259340705150ns, next at 260340699392ns, rc = 0 00010000:00010000:0.0:1789123145.010433:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc91d49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.010454:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc91d49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.010469:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc91d49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.010481:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc91d49 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.010489:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc91d49 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.010497:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc91d49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.010517:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789123145.010551:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc91d42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.010569:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc91d42 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.010576:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc91d42 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.010583:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123145.010590:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc91d42 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.010599:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc91d42 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123145.010956:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789123145.010965:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc91d49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123145.011314:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53400 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123145.011320:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc91d49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123145.011329:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc91d49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123145.011341:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9f34226c1800) 00010000:00010000:1.0:1789123145.011345:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789123145.011351:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc91d49 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123145.011358:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc91d49 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123145.011376:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123145.011378:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123145.011380:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123145.011399:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9f34226c1800) 00010000:00010000:0.0:1789123145.011403:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789123145.011408:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc91d42 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.011415:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc91d42 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.011445:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc91d34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.011451:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc91d34 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.011458:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc91d34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.011463:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53a00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123145.011478:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc91d34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.011485:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc91d34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.011493:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f34226c1a00) 00010000:00010000:0.0:1789123145.011495:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123145.011498:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc91d34 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.011504:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc91d34 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789123145.011577:0:5842:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f0429a48 reply state 0000000013f7382f transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc91d3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123145.011590:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789123145.011893:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f341848a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+16:9901:x1876031364421504:12345-192.168.206.30@tcp:36:rm.0 Request processed in 4215us (4576us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789123145.011904:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 30 00000100:00100000:1.0:1789123145.015472:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123145.015548:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364421760 00000100:00100000:2.0:1789123145.015562:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364421760 00000100:00100000:2.0:1789123145.015679:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 5 00000100:00100000:2.0:1789123145.015691:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407d3f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+16:9901:x1876031364421760:12345-192.168.206.30@tcp:35:rm.0 00000100:00100000:2.0:1789123145.016023:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407d3f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+17:9901:x1876031364421760:12345-192.168.206.30@tcp:35:rm.0 Request processed in 333us (565us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789123145.016032:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 5 00010000:00010000:3.0:1789123145.019315:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc91d3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123145.019340:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc91d3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123145.019350:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc91d3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123145.019358:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53000 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123145.019363:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc91d3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123145.019373:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc91d3b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123145.019399:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xfd685d83 (ffff9f34226c1600) 00010000:00010000:3.0:1789123145.019403:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123145.019410:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc91d3b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123145.019417:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc91d3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123145.019856:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123145.019965:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364422016 00000100:00100000:0.0:1789123145.019979:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364422016 00000100:00100000:0.0:1789123145.020045:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 31 00000100:00100000:0.0:1789123145.020056:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407d3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+16:9901:x1876031364422016:12345-192.168.206.30@tcp:36:rm.0 00010000:00010000:0.0:1789123145.020145:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789123145.020170:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2200/0x7e1648d68fc91d0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f542 expref: 16 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.020191:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc91ca8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f51f expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.020219:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f34226c1a00) 00010000:00010000:0.0:1789123145.020235:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52000/0x7e1648d68fc91c69 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f511 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.020242:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34226c1100) 00010000:00010000:0.0:1789123145.020249:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789123145.020281:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc91d50 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.020295:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc91d50 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.020307:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc91d50 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.020321:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52e00/0x7e1648d68fc91d57 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.020328:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52e00/0x7e1648d68fc91d57 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.020333:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52e00/0x7e1648d68fc91d57 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.020840:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc91d5e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.020850:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc91d5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.020871:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc91d5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123145.021584:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1789123145.021609:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc91d5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.021663:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc91d5e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.021670:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc91d5e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.021676:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53800 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123145.021681:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc91d5e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.021690:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc91d5e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.021703:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f34226c1000) 00010000:00010000:0.0:1789123145.021706:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789123145.021711:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc91d5e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.021717:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc91d5e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.021742:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc91d50 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.021748:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc91d50 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.021761:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc91d50 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.021766:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123145.021769:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc91d50 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.021776:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc91d50 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.021784:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34226c1900) 00010000:00010000:0.0:1789123145.021786:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123145.021789:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc91d50 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.021796:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc91d50 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789123145.021809:0:5840:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000090273ac0 reply state 000000000be12e82 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52e00/0x7e1648d68fc91d57 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123145.021821:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789123145.021940:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407d3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+15:9901:x1876031364422016:12345-192.168.206.30@tcp:36:rm.0 Request processed in 1882us (2088us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789123145.021951:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 31 00010000:00010000:0.0:1789123145.026606:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52e00/0x7e1648d68fc91d57 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.026670:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52e00/0x7e1648d68fc91d57 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.026709:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52e00/0x7e1648d68fc91d57 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.026716:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52e00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123145.026722:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52e00/0x7e1648d68fc91d57 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.026731:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52e00/0x7e1648d68fc91d57 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.026756:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f34226c1200) 00010000:00010000:0.0:1789123145.026760:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123145.026766:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52e00/0x7e1648d68fc91d57 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123145.026773:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52e00/0x7e1648d68fc91d57 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123145.225571:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123146.244970:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123146.247359:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789123146.247391:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f341848b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381233536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789123146.247493:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123146.247689:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381233536 00000100:00100000:2.0:1789123146.247700:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381233536 00000100:00100000:2.0:1789123146.247783:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789123146.247795:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381233536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789123146.247865:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123146.247927:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381233536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123146.247935:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1789123146.247973:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789123146.248279:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f341848b480 x1876031381233536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123146.248306:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f341848b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381233536:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789123147.269079:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123147.679507:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123147.679546:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123147.679582:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123147.679739:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123147.679862:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364422144 00000100:00100000:2.0:1789123147.679873:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364422144 00000100:00100000:2.0:1789123147.679935:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 274 00000100:00100000:2.0:1789123147.679947:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+13:2352:x1876031364422144:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1789123147.680020:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+13:2352:x1876031364422144:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 76us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123147.680029:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 274 00000100:00100000:3.0:1789123147.680463:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364422272 00000100:00100000:3.0:1789123147.680469:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364422272 00000100:00100000:3.0:1789123147.680519:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364422528 00000100:00100000:3.0:1789123147.680522:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364422528 00000100:00100000:3.0:1789123147.680561:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 106 00000100:00100000:3.0:1789123147.680568:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407d3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+14:2352:x1876031364422272:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1789123147.680623:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407d3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+14:2352:x1876031364422272:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 55us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123147.680663:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 106 00000100:00100000:3.0:1789123147.680678:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 107 00000100:00100000:3.0:1789123147.680685:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407d3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2352:x1876031364422528:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1789123147.680711:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407d3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2352:x1876031364422528:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 27us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123147.680717:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 107 00000100:00100000:0.0:1789123147.681759:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364422400 00000100:00100000:0.0:1789123147.681771:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364422400 00000100:00100000:0.0:1789123147.681844:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 50 00000100:00100000:0.0:1789123147.681854:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407d3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2352:x1876031364422400:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123147.681926:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407d3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2352:x1876031364422400:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 63us (2368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123147.681933:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 50 00000100:00080000:2.0:1789123147.682664:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789123147.682671:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789123148.298388:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789123148.940304:0:12012:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1789123149.317496:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123149.830550:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f340665c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381233664:0@lo:400:kworker.0 00000100:00100000:3.0:1789123149.830611:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381234048:0@lo:400:kworker.0 00000100:00100000:1.0:1789123149.830791:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f340665fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876031381233792:0@lo:400:kworker.0 00000100:00100000:3.0:1789123149.833662:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123149.833777:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789123149.833794:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876031381233920:0@lo:400:kworker.0 00000100:00100000:3.0:1789123149.833853:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123149.833913:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381234048 00000100:00100000:3.0:1789123149.833923:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381234048 00000100:00100000:3.0:1789123149.834011:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789123149.834023:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381234048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123149.834092:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381234048:12345-0@lo:400:kworker.0 Request processed in 70us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123149.834100:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789123149.834129:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381233920 00000100:00100000:3.0:1789123149.834133:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381233920 00000100:00100000:3.0:1789123149.834164:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789123149.834190:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876031381233920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123149.834224:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876031381233920:12345-0@lo:400:kworker.0 Request processed in 37us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123149.834231:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789123149.834288:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876031381233920:0@lo:400:kworker.0 00010000:00080000:3.0:1789123149.834304:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34365ccb40 x1876031381234048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123149.834317:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381234048:0@lo:400:kworker.0 00000100:00100000:0.0:1789123149.835404:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123149.835787:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123149.835841:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381234304:0@lo:400:kworker.0 00000100:00100000:1.0:1789123149.835886:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123149.835918:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789123149.835926:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876031381234176:0@lo:400:kworker.0 00000004:00080000:0.0:1789123149.835955:0:7674:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 264166326395ns, next at 265166322424ns, rc = 0 00000100:00100000:1.0:1789123149.835964:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123149.835986:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381234432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789123149.836023:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123149.836091:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381233792 00000100:00100000:0.0:1789123149.836099:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381233792 00000100:00100000:0.0:1789123149.836143:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381234176 00000100:00100000:0.0:1789123149.836146:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381234176 00000100:00100000:0.0:1789123149.836171:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789123149.836179:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407d3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876031381233792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123149.836234:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407d3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876031381233792:12345-0@lo:400:kworker.0 Request processed in 55us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123149.836242:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789123149.836261:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789123149.836267:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407d3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876031381234176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123149.836295:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407d3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876031381234176:12345-0@lo:400:kworker.0 Request processed in 28us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123149.836301:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789123149.836320:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381234304 00000100:00100000:0.0:1789123149.836324:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381234304 00000100:00100000:0.0:1789123149.836354:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789123149.836360:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381234304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123149.836407:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381234304:12345-0@lo:400:kworker.0 Request processed in 48us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123149.836414:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789123149.836455:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381234432 00000100:00100000:1.0:1789123149.836460:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381234432 00000100:00100000:1.0:1789123149.836501:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789123149.836509:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409c98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381234432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789123149.836542:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789123149.836693:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409c98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381234432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 184us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123149.836700:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1789123149.836894:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789123149.836901:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789123149.836904:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789123149.836919:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381233664 00000100:00100000:2.0:1789123149.836924:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381233664 00000100:00100000:2.0:1789123149.836955:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789123149.836963:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3302:x1876031381233664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123149.837007:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3302:x1876031381233664:12345-0@lo:400:kworker.0 Request processed in 44us (1609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123149.837014:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1789123149.837936:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876031381234176:0@lo:400:kworker.0 00000100:00100000:0.0:1789123149.837973:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f340665fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876031381233792:0@lo:400:kworker.0 00010000:00080000:0.0:1789123149.837991:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34365cc780 x1876031381234304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123149.838003:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381234304:0@lo:400:kworker.0 00010000:00080000:0.0:1789123149.838055:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3409c9b840 x1876031381234432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123165 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123149.838073:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381234432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789123149.838123:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f340665c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381233664:0@lo:400:kworker.0 00000004:00080000:3.0:1789123149.948522:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1789123149.948553:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1789123149.948562:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1789123149.948798:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381234560:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789123149.948894:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123149.948984:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381234560 00000100:00100000:3.0:1789123149.948993:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381234560 00000100:00100000:3.0:1789123149.949045:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789123149.949055:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381234560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789123149.949090:0:6688:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1789123149.949134:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa3da48, atime: 0x6aa3da48, ctime: 0x6aa3da48, blocks: 0x1 00010000:00010000:3.0:1789123149.949143:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f70b4396/0x7e1648d68fc91d65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123149.949164:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=264s v=(0 0) 00010000:00010000:3.0:1789123149.949169:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789123149.949177:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f70b4396/0x7e1648d68fc91d65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123149.949217:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f70b4396/0x7e1648d68fc91d65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123149.949229:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f70b4396/0x7e1648d68fc91d65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123149.949238:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f70b4396/0x7e1648d68fc91d65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123149.949256:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789123149.949941:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1876031381234560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 883us (1044us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789123149.949951:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1789123149.949992:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789123149.949999:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f70b4396/0x7e1648d68fc91d65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123149.950009:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34029f2600 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:3.0:1789123149.950014:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f70b4396/0x7e1648d68fc91d65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123149.950024:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f70b4396/0x7e1648d68fc91d65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123149.950045:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f70b4396/0x7e1648d68fc91d65 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123149.950060:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f70b4396/0x7e1648d68fc91d65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123149.950084:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123149.950086:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123149.950088:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789123149.950132:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f34365cc780/2, rc 0, transno 4294967300 00000100:00100000:3.0:1789123149.950140:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381234560:0@lo:6:osp-syn-1-0.0 00000020:00000080:0.0:1789123149.973083:0:12062:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe4a6cc510 20000000:00000080:0.0:1789123149.973109:0:12062:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f34355c9000 uarg=0000000000000000 20000000:01000000:0.0:1789123149.973160:0:12062:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789123149.973170:0:12062:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789123149.973177:0:12062:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1789123149.974113:0:12063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:0.0:1789123149.974320:0:12062:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1789123149.982283:0:12062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10128 00000040:00080000:1.0:1789123149.982374:0:12062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10256 00000040:00080000:1.0:1789123149.982415:0:12062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10480 10000000:01000000:1.0:1789123149.982436:0:12062:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789123149.982461:0:12062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f343bd33c00/0x7e1648d68fc91d6c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123149.982485:0:12062:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f3435b52a00/0x7e1648d68fc91c0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91c07 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123149.982492:0:12062:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f3435b52200/0x7e1648d68fc91c1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91c15 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123149.982509:0:12062:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f3435b52400/0x7e1648d68fc91c2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91c23 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123149.982520:0:12062:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f3435b53200/0x7e1648d68fc91c31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4fc expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123149.982529:0:12062:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f343bd32800/0x7e1648d68fc91c38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f503 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123149.982537:0:12062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f343bd33c00/0x7e1648d68fc91d6c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123149.982805:0:12062:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f343bd32800/0x7e1648d68fc91c38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f503 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123149.982826:0:12062:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f343bd32800/0x7e1648d68fc91c38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f503 expref: 12 pid: 5834 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123149.982844:0:12062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3407d3f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12062:1876031381234688:192.168.206.30@tcp:104: 00010000:00010000:1.0:1789123149.983055:0:12062:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f3435b53200/0x7e1648d68fc91c31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4fc expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123149.983064:0:12062:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f3435b53200/0x7e1648d68fc91c31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4fc expref: 12 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123149.983073:0:12062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3407d3e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12062:1876031381234816:192.168.206.30@tcp:104: 00010000:00010000:1.0:1789123149.983109:0:12062:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f3435b52400/0x7e1648d68fc91c2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc91c23 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123149.983131:0:12062:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f3435b52400/0x7e1648d68fc91c2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc91c23 expref: 18 pid: 5833 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123149.983142:0:12062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3407d3d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12062:1876031381234944:0@lo:104: 00000100:00100000:1.0:1789123149.983200:0:12062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789123149.983290:0:12062:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f3435b52200/0x7e1648d68fc91c1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc91c15 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123149.983300:0:12062:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f3435b52200/0x7e1648d68fc91c1c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc91c15 expref: 18 pid: 5834 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123149.983308:0:12062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3405de0f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12062:1876031381235072:0@lo:104: 00000100:00100000:1.0:1789123149.983348:0:12062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789123149.984005:0:12062:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f3435b52a00/0x7e1648d68fc91c0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc91c07 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123149.984017:0:12062:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f3435b52a00/0x7e1648d68fc91c0e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc91c07 expref: 18 pid: 5835 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123149.984027:0:12062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d768780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12062:1876031381235200:0@lo:104: 00000100:00100000:1.0:1789123149.984058:0:12062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123149.984101:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381234944 00000100:00100000:0.0:1789123149.984111:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381234944 00000100:00100000:0.0:1789123149.984159:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381235072 00000100:00100000:0.0:1789123149.984163:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381235072 00000100:00100000:0.0:1789123149.984179:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789123149.984189:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407d3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+4:12062:x1876031381234944:12345-0@lo:104: 00010000:00010000:0.0:1789123149.984216:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f3435b53c00/0x7e1648d68fc91c23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91c2a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123149.984286:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789123149.984293:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407d3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+4:12062:x1876031381234944:12345-0@lo:104: Request processed in 105us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123149.984301:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789123149.984343:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789123149.984350:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d769a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:12062:x1876031381235072:12345-0@lo:104: 00010000:00010000:0.0:1789123149.984359:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91c15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91c1c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123149.984395:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789123149.984401:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d769a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:12062:x1876031381235072:12345-0@lo:104: Request processed in 53us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123149.984407:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1789123149.984567:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789123149.984576:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f3435b53c00/0x7e1648d68fc91c23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91c2a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123149.984585:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53c00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1789123149.984603:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f3435b53c00/0x7e1648d68fc91c23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc91c2a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123149.984662:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f3435b53c00/0x7e1648d68fc91c23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc91c2a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789123149.984672:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f3435b53c00/0x7e1648d68fc91c23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc91c2a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123149.984678:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789123149.984715:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f3435b53c00/0x7e1648d68fc91c23 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91c2a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123149.984722:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789123149.984743:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f3435b53c00/0x7e1648d68fc91c23 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91c2a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123149.984751:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f3435b53c00/0x7e1648d68fc91c23 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91c2a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123149.984766:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789123149.984769:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91c15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91c1c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123149.984774:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32a00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1789123149.984777:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91c15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc91c1c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123149.984783:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91c15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc91c1c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789123149.984789:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91c15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc91c1c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123149.984801:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789123149.984818:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91c15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91c1c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123149.984825:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789123149.984832:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91c15 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91c1c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123149.984839:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f343bd32a00/0x7e1648d68fc91c15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91c1c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123149.984849:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123149.984851:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123149.984852:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123149.984927:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381235328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789123149.984970:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123149.985011:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789123149.985017:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381235456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789123149.985038:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123149.985114:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381235328 00000100:00100000:2.0:1789123149.985119:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381235328 00010000:00010000:2.0:1789123149.985146:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f3435b52400/0x7e1648d68fc91c2a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91c23 expref: 19 pid: 5833 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123149.985178:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381235456 00000100:00100000:2.0:1789123149.985181:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381235456 00010000:00010000:2.0:1789123149.985194:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f3435b52200/0x7e1648d68fc91c1c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91c15 expref: 20 pid: 5834 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123149.985213:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789123149.985220:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409c9b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+20:3302:x1876031381235328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789123149.985233:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123149.985239:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f3435b52400/0x7e1648d68fc91c2a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91c23 expref: 20 pid: 5833 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123149.985260:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f3435b52400/0x7e1648d68fc91c2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc91c23 expref: 20 pid: 5833 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123149.985282:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123149.985316:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409c9b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+20:3302:x1876031381235328:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123149.985323:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789123149.985339:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789123149.985346:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409c98f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3302:x1876031381235456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789123149.985354:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123149.985358:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f3435b52200/0x7e1648d68fc91c1c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91c15 expref: 19 pid: 5834 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123149.985366:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f3435b52200/0x7e1648d68fc91c1c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc91c15 expref: 19 pid: 5834 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123149.985376:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123149.985395:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409c98f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3302:x1876031381235456:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123149.985401:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789123149.985481:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381235456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789123149.985491:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381235328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789123149.985797:0:12062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410bcd3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789123149.985817:0:12062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3435b52400/0x7e1648d68fc91c2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc91c23 expref: 18 pid: 5833 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123149.985829:0:12062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3407d3d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12062:1876031381234944:0@lo:104: 00010000:00010000:1.0:1789123149.985839:0:12062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3435b52200/0x7e1648d68fc91c1c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc91c15 expref: 17 pid: 5834 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123149.985860:0:12062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3405de0f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12062:1876031381235072:0@lo:104: 00000100:00100000:0.0:1789123149.985915:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381235200 00000100:00100000:0.0:1789123149.985920:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381235200 00000100:00100000:0.0:1789123149.985944:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789123149.985959:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d76bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:12062:x1876031381235200:12345-0@lo:104: 00010000:00010000:0.0:1789123149.985972:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f342d80b200/0x7e1648d68fc91c07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91c0e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123149.986033:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789123149.986039:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d76bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+3:12062:x1876031381235200:12345-0@lo:104: Request processed in 82us (1980us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123149.986045:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1789123149.986094:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789123149.986099:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f342d80b200/0x7e1648d68fc91c07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc91c0e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123149.986107:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80b200 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1789123149.986111:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f342d80b200/0x7e1648d68fc91c07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc91c0e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123149.986130:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f342d80b200/0x7e1648d68fc91c07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc91c0e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789123149.986138:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f342d80b200/0x7e1648d68fc91c07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc91c0e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123149.986144:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789123149.986179:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f342d80b200/0x7e1648d68fc91c07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91c0e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123149.986186:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789123149.986210:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f342d80b200/0x7e1648d68fc91c07 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91c0e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123149.986217:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f342d80b200/0x7e1648d68fc91c07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc91c0e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123149.986233:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123149.986235:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123149.986237:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123149.986315:0:12062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d768780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12062:1876031381235200:0@lo:104: 00010000:00010000:3.0:1789123149.986545:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123149.986567:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381235584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789123149.986925:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123149.987082:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381235584 00000100:00100000:2.0:1789123149.987089:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381235584 00010000:00010000:2.0:1789123149.987118:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f3435b52a00/0x7e1648d68fc91c0e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91c07 expref: 17 pid: 5835 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123149.987178:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789123149.987187:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:3304:x1876031381235584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789123149.987200:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123149.987205:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f3435b52a00/0x7e1648d68fc91c0e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc91c07 expref: 17 pid: 5835 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123149.987225:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f3435b52a00/0x7e1648d68fc91c0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc91c07 expref: 17 pid: 5835 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123149.987243:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3435b52a00/0x7e1648d68fc91c0e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc91c07 expref: 17 pid: 5835 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123149.987257:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123149.987304:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:3304:x1876031381235584:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123149.987311:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789123149.987377:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381235584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789123149.990189:0:12062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3407d3f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12062:1876031381234688:192.168.206.30@tcp:104: 00000100:00100000:2.0:1789123149.990212:0:12062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3407d3e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12062:1876031381234816:192.168.206.30@tcp:104: 00010000:00010000:2.0:1789123149.990266:0:12062:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f343bd33c00/0x7e1648d68fc91d6c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123149.990843:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123149.990945:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123149.991022:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364422784 00000100:00100000:3.0:1789123149.991031:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364422784 00010000:00010000:3.0:1789123149.991076:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f3435b53200/0x7e1648d68fc91c31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4fc expref: 13 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123149.991113:0:11614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364422656 00000100:00100000:1.0:1789123149.991119:0:11614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364422656 00000100:00100000:3.0:1789123149.991122:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 38 00000100:00100000:3.0:1789123149.991136:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19924a15-1c73-4644-a9ca-864666412d45+14:2354:x1876031364422784:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789123149.991152:0:11614:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f343bd32800/0x7e1648d68fc91c38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f503 expref: 14 pid: 5834 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123149.991155:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123149.991165:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f3435b53200/0x7e1648d68fc91c31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4fc expref: 14 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123149.991178:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f3435b53200/0x7e1648d68fc91c31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4fc expref: 14 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123149.991193:0:11614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 39 00000100:00100000:1.0:1789123149.991203:0:11614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3406286c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19924a15-1c73-4644-a9ca-864666412d45+14:2354:x1876031364422656:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789123149.991227:0:11614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123149.991234:0:11614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f343bd32800/0x7e1648d68fc91c38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f503 expref: 14 pid: 5834 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123149.991240:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3435b53200/0x7e1648d68fc91c31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4fc expref: 14 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123149.991252:0:11614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f343bd32800/0x7e1648d68fc91c38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f503 expref: 14 pid: 5834 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123149.991267:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789123149.991349:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:19924a15-1c73-4644-a9ca-864666412d45+13:2354:x1876031364422784:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 215us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123149.991358:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 38 00010000:00010000:1.0:1789123149.991550:0:11614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f343bd32800/0x7e1648d68fc91c38 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f503 expref: 12 pid: 5834 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123149.991565:0:11614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f343bd33c00/0x7e1648d68fc91d6c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123149.991575:0:11614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f343bd33c00/0x7e1648d68fc91d6c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123149.991737:0:11614:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f343bd33c00/0x7e1648d68fc91d6c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123149.991759:0:11614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f343bd33c00/0x7e1648d68fc91d6c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123149.991767:0:11614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f343bd33c00/0x7e1648d68fc91d6c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123149.991774:0:11614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f343bd33c00/0x7e1648d68fc91d6c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123149.991783:0:11614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33c00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123149.991788:0:11614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f343bd33c00/0x7e1648d68fc91d6c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123149.991799:0:11614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f343bd33c00/0x7e1648d68fc91d6c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123149.991974:0:12062:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f343bd33c00/0x7e1648d68fc91d6c lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123149.991983:0:12062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f343bd33c00/0x7e1648d68fc91d6c lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123149.993218:0:11614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f343bd33c00/0x7e1648d68fc91d6c lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123149.993237:0:11614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f343bd33c00/0x7e1648d68fc91d6c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123149.993255:0:11614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789123149.993346:0:11614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3406286c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19924a15-1c73-4644-a9ca-864666412d45+11:2354:x1876031364422656:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 2139us (2394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123149.993359:0:11614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 39 00010000:00010000:1.0:1789123150.344570:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789123150.407110:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:0.0:1789123151.366685:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381235712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789123151.366795:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1789123151.366802:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789123151.366808:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f3406274800 from 10 10000000:01000000:1.0:1789123151.366830:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789123151.366884:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd32800/0x7e1648d68fc91d73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123151.366898:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f343bd32800/0x7e1648d68fc91d73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123151.366910:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f343bd32800/0x7e1648d68fc91d73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123151.366927:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d76b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381235840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789123151.366967:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123151.367004:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410bcd840 going to sleep for 11 seconds 00010000:00010000:3.0:1789123151.367140:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123151.367156:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381235712 00000100:00100000:2.0:1789123151.367167:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381235712 00000100:00100000:2.0:1789123151.367256:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789123151.367268:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f341848b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381235712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789123151.367318:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123151.367391:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f341848b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381235712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123151.367409:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1789123151.367496:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789123151.368449:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381235840 00000100:00100000:0.0:1789123151.368459:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381235840 00000100:00100000:0.0:1789123151.368533:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789123151.368542:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:5838:x1876031381235840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789123151.368558:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123151.368590:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3435b52e00/0x7e1648d68fc91d7a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91d73 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123151.368623:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3435b52e00/0x7e1648d68fc91d7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91d73 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123151.368673:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3435b52e00/0x7e1648d68fc91d7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91d73 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123151.368684:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b52e00, rc 0) 00000100:00100000:0.0:1789123151.368745:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381235840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (1777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123151.368763:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00010000:00080000:0.0:1789123151.368825:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34355183c0 x1876031381235712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123151.368859:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381235712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789123151.369060:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d76b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381235840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789123151.369080:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f343bd32800/0x7e1648d68fc91d73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91d7a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123151.369090:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f343bd32800/0x7e1648d68fc91d73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91d7a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123151.369164:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381235968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789123151.369198:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123151.369234:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410be0480 going to sleep for 11 seconds 00000100:00100000:2.0:1789123151.369566:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381235968 00000100:00100000:2.0:1789123151.369573:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381235968 00000100:00100000:2.0:1789123151.369653:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789123151.369664:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381235968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789123151.370017:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381235968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 353us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123151.370026:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789123151.370413:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381235968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789123151.370463:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381236096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789123151.370516:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123151.370546:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410be0480 going to sleep for 11 seconds 00000100:00100000:2.0:1789123151.370860:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381236096 00000100:00100000:2.0:1789123151.370866:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381236096 00000100:00100000:2.0:1789123151.371006:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789123151.371016:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381236096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789123151.371230:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381236096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 215us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123151.371237:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789123151.371332:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381236096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789123151.371702:0:12076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:12076:1876031381236224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789123151.371751:0:12076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123151.379687:0:12076:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410be0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789123151.379747:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381236224 00000100:00100000:1.0:1789123151.379761:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381236224 00000100:00100000:1.0:1789123151.379837:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789123151.379848:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:12076:x1876031381236224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789123151.380357:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:12076:x1876031381236224:12345-0@lo:502:llog_process_th.0 Request processed in 508us (8603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123151.380368:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789123151.380530:0:12076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:12076:1876031381236224:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789123151.380589:0:12076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789123151.380602:0:12076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123151.380605:0:12076:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789123151.380614:0:12076:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f3406274800 00000020:00000080:3.0:1789123151.380616:0:12076:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789123151.380776:0:12076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:12076:1876031381236352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789123151.380830:0:12076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123151.380859:0:12076:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410be0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789123151.381433:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381236352 00000100:00100000:2.0:1789123151.381443:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381236352 00000100:00100000:2.0:1789123151.381792:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789123151.381808:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:12076:x1876031381236352:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789123151.382107:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:12076:x1876031381236352:12345-0@lo:502:llog_process_th.0 Request processed in 303us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123151.382115:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1789123151.386891:0:12076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:12076:1876031381236352:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789123151.386967:0:12076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789123151.386984:0:12076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123151.386987:0:12076:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789123151.386993:0:12076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789123151.387113:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:3.0:1789123151.387135:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789123151.387149:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd32800/0x7e1648d68fc91d73 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91d7a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123151.387163:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f343bd32800/0x7e1648d68fc91d73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91d7a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789123151.387177:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789123151.387180:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f343be04000 from 10 10000000:01000000:3.0:1789123151.387185:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789123151.387234:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91d81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123151.387252:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91d81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123151.388389:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91d81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123151.388436:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381236480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789123151.388933:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123151.389048:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410be0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789123151.393910:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381236480 00000100:00100000:2.0:1789123151.393932:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381236480 00000100:00100000:2.0:1789123151.394016:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789123151.394028:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:5838:x1876031381236480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789123151.394062:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123151.394088:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f342d80b200/0x7e1648d68fc91d88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91d81 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123151.394124:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f342d80b200/0x7e1648d68fc91d88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91d81 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123151.394137:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f342d80b200/0x7e1648d68fc91d88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91d81 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123151.394148:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80b200, rc 0) 00000100:00100000:2.0:1789123151.394260:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381236480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 234us (5723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123151.394268:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1789123151.394371:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381236480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789123151.394398:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91d81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91d88 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123151.394410:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91d81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91d88 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123151.394571:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381236608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789123151.394649:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123151.394691:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410be0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789123151.394708:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381236608 00000100:00100000:3.0:1789123151.394713:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381236608 00000100:00100000:3.0:1789123151.394847:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789123151.394859:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381236608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789123151.395573:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381236608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 715us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123151.395593:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789123151.395681:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381236608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789123151.395845:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381236736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789123151.396233:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123151.396263:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410be0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789123151.396288:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381236736 00000100:00100000:3.0:1789123151.396294:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381236736 00000100:00100000:3.0:1789123151.396333:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1789123151.396342:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381236736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789123151.397186:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381236736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 840us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123151.397199:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789123151.397252:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381236736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789123151.398893:0:12079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:12079:1876031381236864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789123151.399078:0:12079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123151.399212:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381236864 00000100:00100000:2.0:1789123151.399221:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381236864 00000100:00100000:2.0:1789123151.399280:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789123151.399293:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:12079:x1876031381236864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789123151.399797:0:12079:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410be0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789123151.400996:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:12079:x1876031381236864:12345-0@lo:502:llog_process_th.0 Request processed in 1697us (1910us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123151.401012:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1789123151.401187:0:12079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:12079:1876031381236864:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789123151.401247:0:12079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789123151.401260:0:12079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123151.401263:0:12079:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789123151.401270:0:12079:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f343be04000 00000020:00000080:3.0:1789123151.401273:0:12079:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789123151.402322:0:12079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:12079:1876031381236992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789123151.402877:0:12079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123151.403006:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381236992 00000100:00100000:3.0:1789123151.403015:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381236992 00000100:00100000:3.0:1789123151.403083:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1789123151.403095:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:12079:x1876031381236992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789123151.403547:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:12079:x1876031381236992:12345-0@lo:502:llog_process_th.0 Request processed in 452us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123151.403557:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1789123151.403656:0:12079:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410be0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789123151.403860:0:12079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:12079:1876031381236992:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789123151.403974:0:12079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789123151.403984:0:12079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123151.403986:0:12079:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789123151.403992:0:12079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789123151.404085:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:3.0:1789123151.404174:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789123151.404188:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91d81 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91d88 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123151.404201:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91d81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91d88 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789123151.404215:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789123151.404218:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f3408401800 from 10 10000000:01000000:3.0:1789123151.404221:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789123151.404260:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34029f3a00/0x7e1648d68fc91d8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123151.404269:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f34029f3a00/0x7e1648d68fc91d8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123151.404294:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f34029f3a00/0x7e1648d68fc91d8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123151.404316:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381237120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789123151.404471:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123151.404502:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410be0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789123151.404520:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381237120 00000100:00100000:3.0:1789123151.404525:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381237120 00000100:00100000:3.0:1789123151.404557:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789123151.404566:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:5838:x1876031381237120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789123151.404590:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123151.404607:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f34029f2200/0x7e1648d68fc91d96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc91d8f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123151.404662:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f34029f2200/0x7e1648d68fc91d96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc91d8f expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123151.404792:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f34029f2200/0x7e1648d68fc91d96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc91d8f expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123151.404802:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f34029f2200, rc 0) 00000100:00100000:3.0:1789123151.404839:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:5838:x1876031381237120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 274us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123151.404846:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789123151.404886:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381237120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789123151.404900:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f34029f3a00/0x7e1648d68fc91d8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91d96 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123151.404984:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f34029f3a00/0x7e1648d68fc91d8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91d96 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123151.405043:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381237248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789123151.405071:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123151.405085:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410be0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789123151.405099:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381237248 00000100:00100000:3.0:1789123151.405102:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381237248 00000100:00100000:3.0:1789123151.405435:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789123151.405444:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340494c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:5838:x1876031381237248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789123151.406203:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340494c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:5838:x1876031381237248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 758us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123151.406213:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789123151.406267:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381237248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789123151.406315:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381237376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789123151.406486:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123151.407827:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410be0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789123151.407869:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381237376 00000100:00100000:3.0:1789123151.407880:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381237376 00000100:00100000:3.0:1789123151.408064:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789123151.408076:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:5838:x1876031381237376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789123151.408550:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:5838:x1876031381237376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 474us (2061us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123151.408560:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789123151.408842:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd41f4a0-f4e3-41a1-856e-0c34af912023:5838:1876031381237376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789123151.409325:0:12080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:12080:1876031381237504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789123151.409484:0:12080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123151.409518:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381237504 00000100:00100000:3.0:1789123151.409524:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381237504 00000100:00100000:3.0:1789123151.409559:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789123151.409568:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:12080:x1876031381237504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789123151.409805:0:12080:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410be0540 going to sleep for 11 seconds 00000100:00100000:3.0:1789123151.410096:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:12080:x1876031381237504:12345-0@lo:502:llog_process_th.0 Request processed in 528us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123151.410105:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1789123151.410213:0:12080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365ccf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:12080:1876031381237504:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789123151.410252:0:12080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789123151.410266:0:12080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789123151.410269:0:12080:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789123151.410277:0:12080:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f3408401800 00000020:00000080:2.0:1789123151.410281:0:12080:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789123151.410609:0:12080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355183c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:12080:1876031381237632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789123151.410712:0:12080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123151.410743:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381237632 00000100:00100000:0.0:1789123151.410750:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381237632 00000100:00100000:2.0:1789123151.410756:0:12080:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340679a900 going to sleep for 11 seconds 00000100:00100000:0.0:1789123151.410797:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1789123151.410807:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:12080:x1876031381237632:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789123151.411263:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:12080:x1876031381237632:12345-0@lo:502:llog_process_th.0 Request processed in 456us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123151.411272:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1789123151.411380:0:12080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355183c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd41f4a0-f4e3-41a1-856e-0c34af912023:12080:1876031381237632:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789123151.411409:0:12080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789123151.411416:0:12080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789123151.411419:0:12080:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789123151.411423:0:12080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789123151.411574:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:0.0:1789123151.411609:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789123151.411648:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34029f3a00/0x7e1648d68fc91d8f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91d96 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123151.411662:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f34029f3a00/0x7e1648d68fc91d8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91d96 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789123151.429780:0:12081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789123151.841243:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123151.844229:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364422912 00000100:00100000:3.0:1789123151.844249:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364422912 00000100:00100000:3.0:1789123151.844359:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 291 00000100:00100000:3.0:1789123151.844373:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+11:5592:x1876031364422912:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789123151.844396:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123151.844422:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f34029f2a00/0x7e1648d68fc91d9d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f550 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123151.844461:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f34029f2a00/0x7e1648d68fc91d9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f550 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123151.844474:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f34029f2a00/0x7e1648d68fc91d9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f550 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123151.844485:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f34029f2a00, rc 0) 00000100:00100000:3.0:1789123151.844592:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+12:5592:x1876031364422912:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 Request processed in 222us (3361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123151.844683:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 291 00000100:00100000:3.0:1789123151.853424:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123151.855112:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364423040 00000100:00100000:0.0:1789123151.855130:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364423040 00000100:00100000:0.0:1789123151.855215:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 292 00000100:00100000:0.0:1789123151.855228:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+12:5592:x1876031364423040:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789123151.856079:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+12:5592:x1876031364423040:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 Request processed in 845us (2660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123151.856106:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 292 00000100:00100000:0.0:1789123151.862148:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123151.869769:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364423168 00000100:00100000:2.0:1789123151.869793:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364423168 00000100:00100000:2.0:1789123151.870126:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 293 00000100:00100000:2.0:1789123151.870140:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+12:5592:x1876031364423168:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789123151.870469:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+12:5592:x1876031364423168:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 Request processed in 329us (8334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123151.870478:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 293 00000100:00100000:1.0:1789123151.879885:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123151.880039:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364423296 00000100:00100000:3.0:1789123151.880051:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364423296 00000100:00100000:3.0:1789123151.880161:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 294 00000100:00100000:3.0:1789123151.880174:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+12:10171:x1876031364423296:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789123151.880517:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+12:10171:x1876031364423296:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 345us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123151.880527:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 294 00000100:00100000:3.0:1789123151.888822:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123151.891324:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364423424 00000100:00100000:0.0:1789123151.891347:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364423424 00000100:00100000:0.0:1789123151.891439:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 295 00000100:00100000:0.0:1789123151.891453:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+12:10171:x1876031364423424:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789123151.892781:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+12:10171:x1876031364423424:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 1320us (3962us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123151.892795:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 295 00000100:00100000:1.0:1789123151.905208:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123151.909195:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364423552 00000100:00100000:2.0:1789123151.909217:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364423552 00000100:00100000:2.0:1789123151.909560:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 296 00000100:00100000:2.0:1789123151.909573:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+12:5592:x1876031364423552:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789123151.909605:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123151.909654:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f342d80b800/0x7e1648d68fc91da4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f557 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123151.909692:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f342d80b800/0x7e1648d68fc91da4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f557 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123151.909706:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f342d80b800/0x7e1648d68fc91da4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f557 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123151.909742:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80b800, rc 0) 00000100:00100000:2.0:1789123151.909846:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+13:5592:x1876031364423552:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 Request processed in 266us (4645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123151.909854:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 296 00000100:00100000:1.0:1789123151.919491:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123151.920029:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364423680 00000100:00100000:2.0:1789123151.920043:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364423680 00000100:00100000:2.0:1789123151.920876:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 297 00000100:00100000:2.0:1789123151.920894:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+13:5592:x1876031364423680:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789123151.922525:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+13:5592:x1876031364423680:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 Request processed in 1624us (3189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123151.922541:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 297 00000100:00100000:3.0:1789123151.925874:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123151.926189:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364423808 00000100:00100000:1.0:1789123151.926223:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364423808 00000100:00100000:1.0:1789123151.926311:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 298 00000100:00100000:1.0:1789123151.926323:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+13:5592:x1876031364423808:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789123151.926868:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+13:5592:x1876031364423808:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 Request processed in 308us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123151.926879:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 298 00000100:00100000:1.0:1789123151.930791:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123151.931174:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364423936 00000100:00100000:2.0:1789123151.931188:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364423936 00000100:00100000:2.0:1789123151.931269:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 299 00000100:00100000:2.0:1789123151.931291:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+13:10174:x1876031364423936:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789123151.931703:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+13:10174:x1876031364423936:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 414us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123151.931712:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 299 00000100:00100000:2.0:1789123151.937172:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123151.937294:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364424064 00000100:00100000:1.0:1789123151.937310:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364424064 00000100:00100000:1.0:1789123151.937385:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 300 00000100:00100000:1.0:1789123151.937398:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+13:10174:x1876031364424064:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789123151.937822:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+13:10174:x1876031364424064:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 425us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123151.937833:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 300 00010000:00010000:1.0:1789123152.389522:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789123152.454301:0:12081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789123152.794743:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123152.794788:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123152.794844:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123152.794885:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123152.795086:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364424320 00000100:00100000:1.0:1789123152.795098:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364424320 00000100:00100000:1.0:1789123152.795176:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364424576 00000100:00100000:1.0:1789123152.795179:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364424576 00000100:00100000:1.0:1789123152.795203:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 111 00000100:00100000:1.0:1789123152.795214:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2354:x1876031364424320:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1789123152.795252:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364424192 00000100:00100000:2.0:1789123152.795259:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364424192 00000100:00100000:2.0:1789123152.795313:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 301 00000100:00100000:1.0:1789123152.795319:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2354:x1876031364424320:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 106us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123152.795326:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+13:2354:x1876031364424192:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123152.795333:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 111 00000100:00100000:1.0:1789123152.795356:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 112 00000100:00100000:2.0:1789123152.795363:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+13:2354:x1876031364424192:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 41us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123152.795366:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2354:x1876031364424576:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1789123152.795395:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 301 00000100:00100000:1.0:1789123152.795421:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2354:x1876031364424576:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 57us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123152.795429:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 112 00000100:00100000:0.0:1789123152.795620:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364424448 00000100:00100000:0.0:1789123152.795661:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364424448 00000100:00100000:0.0:1789123152.795696:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 53 00000100:00100000:0.0:1789123152.795703:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2354:x1876031364424448:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123152.795750:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2354:x1876031364424448:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 47us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123152.795757:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 53 00000100:00080000:3.0:1789123152.796078:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789123152.796084:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789123153.413225:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123154.437107:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123154.949516:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3418488b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381237760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789123154.949674:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123154.949868:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34354f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876031381238016:0@lo:400:kworker.0 00000100:00100000:3.0:1789123154.949908:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123154.949982:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3404939a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381238528:0@lo:400:kworker.0 00000100:00100000:3.0:1789123154.950010:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123154.950043:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789123154.950049:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34354f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381238144:0@lo:400:kworker.0 00000100:00100000:3.0:1789123154.950072:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123154.950136:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381238528 00000100:00100000:3.0:1789123154.950144:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381238528 00000100:00100000:3.0:1789123154.950216:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789123154.950227:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340493bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381238528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123154.950651:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34354f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd41f4a0-f4e3-41a1-856e-0c34af912023:3303:1876031381237888:0@lo:400:kworker.0 00000100:00100000:1.0:1789123154.950697:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123154.950725:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34354f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876031381238400:0@lo:400:kworker.0 00000100:00100000:1.0:1789123154.950751:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123154.950771:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789123154.950778:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34354f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381238272:0@lo:400:kworker.0 00000100:00100000:1.0:1789123154.950803:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123154.950862:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381238016 00000100:00100000:1.0:1789123154.950868:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381238016 00000100:00100000:1.0:1789123154.950919:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381238144 00000100:00100000:1.0:1789123154.950923:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381238144 00000100:00100000:1.0:1789123154.950940:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381238400 00000100:00100000:1.0:1789123154.950942:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381238400 00000100:00100000:1.0:1789123154.950957:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789123154.950964:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3404938780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876031381238016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123154.951011:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3404938780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876031381238016:12345-0@lo:400:kworker.0 Request processed in 47us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123154.951020:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789123154.951040:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789123154.951045:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340493b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381238144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123154.951076:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340493b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381238144:12345-0@lo:400:kworker.0 Request processed in 30us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123154.951095:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789123154.951107:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789123154.951112:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d76ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876031381238400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123154.951148:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d76ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876031381238400:12345-0@lo:400:kworker.0 Request processed in 35us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123154.951154:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789123154.951337:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381238272 00000100:00100000:0.0:1789123154.951343:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381238272 00000100:00100000:0.0:1789123154.951385:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789123154.951393:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d76a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381238272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123154.951430:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d76a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381238272:12345-0@lo:400:kworker.0 Request processed in 39us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123154.951437:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789123154.951745:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340493bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381238528:12345-0@lo:400:kworker.0 Request processed in 1377us (1592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123154.951757:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789123154.951784:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381237888 00000100:00100000:0.0:1789123154.951790:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381237888 00000100:00080000:3.0:1789123154.951810:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789123154.951817:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789123154.951819:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789123154.951856:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34354f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381238144:0@lo:400:kworker.0 00000100:00100000:1.0:1789123154.951867:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34354f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876031381238400:0@lo:400:kworker.0 00000100:00100000:3.0:1789123154.951876:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34354f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876031381238016:0@lo:400:kworker.0 00000100:00100000:3.0:1789123154.951892:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1789123154.951899:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f34365cc780, transno 4294967300 00010000:00080000:1.0:1789123154.951909:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34354f1e00 x1876031381238272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123154.951916:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3404939a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381238528:0@lo:400:kworker.0 00000100:00100000:1.0:1789123154.951931:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34354f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381238272:0@lo:400:kworker.0 00000100:00100000:2.0:1789123154.956168:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381237760 00000100:00100000:2.0:1789123154.956190:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381237760 00000100:00100000:2.0:1789123154.956277:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789123154.956290:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381237760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789123154.956343:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123154.956440:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381237760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (6766us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123154.956448:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789123154.956508:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3418488b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381237760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789123154.968723:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1789123154.968747:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3303:x1876031381237888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123154.968900:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3303:x1876031381237888:12345-0@lo:400:kworker.0 Request processed in 161us (18201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123154.968908:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1789123154.969094:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34354f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd41f4a0-f4e3-41a1-856e-0c34af912023:3303:1876031381237888:0@lo:400:kworker.0 00010000:00010000:3.0:1789123155.463606:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123156.485177:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789123156.485215:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3405de0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381238656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789123156.485329:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123156.485440:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381238656 00000100:00100000:2.0:1789123156.485450:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381238656 00000100:00100000:2.0:1789123156.485526:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789123156.485538:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407d3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381238656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789123156.485619:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123156.485701:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407d3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381238656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123156.485710:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1789123156.486156:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3405de0f00 x1876031381238656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123172 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123156.486179:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3405de0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381238656:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789123156.486239:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789123156.486425:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123157.510347:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123157.916273:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123157.916325:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123157.916371:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123157.916408:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123157.916414:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364424832 00000100:00100000:0.0:1789123157.916427:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364424832 00000100:00100000:3.0:1789123157.916474:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364424960 00000100:00100000:3.0:1789123157.916478:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364424960 00000100:00100000:0.0:1789123157.916498:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364425088 00000100:00100000:0.0:1789123157.916501:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364425088 00000100:00100000:3.0:1789123157.916512:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 56 00000100:00100000:0.0:1789123157.916522:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 116 00000100:00100000:3.0:1789123157.916524:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340493a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2354:x1876031364424960:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123157.916528:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3404939a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2354:x1876031364424832:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123157.916656:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 117 00000100:00100000:1.0:1789123157.916666:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340493ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2354:x1876031364425088:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1789123157.917132:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340493a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2354:x1876031364424960:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 607us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123157.917143:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 56 00000100:00080000:3.0:1789123157.917202:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789123157.917209:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789123157.918251:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3404939a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2354:x1876031364424832:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 1711us (1982us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123157.918265:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 116 00000100:00100000:0.0:1789123157.918330:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364424704 00000100:00100000:0.0:1789123157.918338:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364424704 00000100:00100000:0.0:1789123157.918377:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 303 00000100:00100000:0.0:1789123157.918384:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34066fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+13:2354:x1876031364424704:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123157.918435:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34066fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+13:2354:x1876031364424704:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 51us (2064us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123157.918442:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 303 00000100:00100000:1.0:1789123157.918570:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340493ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2354:x1876031364425088:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 1903us (2242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123157.918579:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 117 00010000:00010000:1.0:1789123158.533374:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123159.557220:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123160.070341:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3418488b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381239040:0@lo:400:kworker.0 00000100:00100000:1.0:1789123160.070379:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876031381238912:0@lo:400:kworker.0 00000100:00100000:1.0:1789123160.070437:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123160.070462:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123160.070577:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f341848bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381238784:0@lo:400:kworker.0 00000100:00100000:2.0:1789123160.070648:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123160.070690:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381238912 00000100:00100000:2.0:1789123160.070700:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381238912 00000100:00100000:2.0:1789123160.070758:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381239040 00000100:00100000:2.0:1789123160.070762:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381239040 00000100:00100000:2.0:1789123160.070797:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789123160.070808:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d768f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876031381238912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123160.070870:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d768f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876031381238912:12345-0@lo:400:kworker.0 Request processed in 64us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123160.070880:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789123160.070899:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789123160.070905:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381239040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123160.070936:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381239040:12345-0@lo:400:kworker.0 Request processed in 31us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123160.070941:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789123160.071003:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3407d3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381239168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789123160.071078:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123160.071105:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381239168 00000100:00100000:2.0:1789123160.071109:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381239168 00000100:00100000:2.0:1789123160.071137:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789123160.071144:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407d3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381239168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789123160.071177:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123160.071212:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407d3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381239168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123160.071218:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789123160.071279:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381238784 00000100:00100000:2.0:1789123160.071283:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381238784 00000100:00100000:2.0:1789123160.071310:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1789123160.071316:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3302:x1876031381238784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123160.071349:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3302:x1876031381238784:12345-0@lo:400:kworker.0 Request processed in 34us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123160.071356:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1789123160.071735:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3418488b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381239040:0@lo:400:kworker.0 00000100:00080000:3.0:1789123160.073037:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789123160.073050:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789123160.075718:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f341848bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381238784:0@lo:400:kworker.0 00000100:00100000:2.0:1789123160.075768:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3405de0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381239296:0@lo:400:kworker.0 00000100:00100000:2.0:1789123160.075859:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123160.075914:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789123160.075922:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3407d3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876031381239424:0@lo:400:kworker.0 00000100:00100000:2.0:1789123160.075950:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123160.075988:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381239424 00000100:00100000:2.0:1789123160.075994:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381239424 00000100:00100000:2.0:1789123160.076079:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789123160.076088:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876031381239424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123160.076145:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876031381239424:12345-0@lo:400:kworker.0 Request processed in 58us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123160.076153:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1789123160.076174:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789123160.076198:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3407d3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876031381239424:0@lo:400:kworker.0 00000100:00100000:0.0:1789123160.081592:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381239296 00000100:00100000:0.0:1789123160.081616:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381239296 00000100:00100000:0.0:1789123160.081759:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789123160.081774:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381239296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123160.081909:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381239296:12345-0@lo:400:kworker.0 Request processed in 138us (6049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123160.081936:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789123160.082273:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876031381238912:0@lo:400:kworker.0 00000100:00100000:3.0:1789123160.082888:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3407d3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381239168:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789123160.083362:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789123160.083403:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3405de0f00 x1876031381239296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123160.083417:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3405de0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381239296:0@lo:400:kworker.0 00010000:00010000:2.0:1789123160.590736:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123161.604964:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123161.607048:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789123161.618605:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381239552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789123161.618737:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123161.619298:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381239552 00000100:00100000:2.0:1789123161.619312:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381239552 00000100:00100000:2.0:1789123161.619387:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789123161.619399:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3404938b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381239552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789123161.619467:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123161.619560:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3404938b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381239552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 162us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123161.619568:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1789123161.620283:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3409cb7c00 x1876031381239552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123161.620314:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381239552:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789123162.630483:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789123162.695227:0:12081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789123163.036685:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123163.036735:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123163.036776:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123163.036857:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123163.037669:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364425344 00000100:00100000:1.0:1789123163.037685:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364425344 00000100:00100000:1.0:1789123163.037773:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364425600 00000100:00100000:1.0:1789123163.037801:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364425600 00000100:00100000:1.0:1789123163.037838:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 121 00000100:00100000:1.0:1789123163.037851:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2355:x1876031364425344:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123163.037963:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2355:x1876031364425344:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 114us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123163.037972:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 121 00000100:00100000:1.0:1789123163.037992:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 122 00000100:00100000:1.0:1789123163.037999:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407d3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2355:x1876031364425600:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123163.038028:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407d3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2355:x1876031364425600:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 28us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123163.038034:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 122 00000100:00100000:0.0:1789123163.038466:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364425472 00000100:00100000:0.0:1789123163.038473:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364425472 00000100:00100000:0.0:1789123163.038536:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 58 00000100:00100000:0.0:1789123163.038546:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2355:x1876031364425472:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123163.038583:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2355:x1876031364425472:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 40us (1849us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123163.038590:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 58 00000100:00100000:3.0:1789123163.039215:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364425216 00000100:00100000:3.0:1789123163.039225:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364425216 00000100:00100000:3.0:1789123163.039281:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 305 00000100:00100000:3.0:1789123163.039290:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+13:2355:x1876031364425216:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1789123163.039334:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+13:2355:x1876031364425216:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 46us (2665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123163.039354:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 305 00000100:00080000:2.0:1789123163.039797:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789123163.039804:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789123163.652964:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123164.676973:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123165.188937:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381239808:0@lo:400:kworker.0 00000100:00100000:2.0:1789123165.189022:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123165.189087:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381240320:0@lo:400:kworker.0 00000100:00100000:2.0:1789123165.189117:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123165.189147:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789123165.189153:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381239936:0@lo:400:kworker.0 00000100:00100000:2.0:1789123165.189176:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123165.189422:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381239808 00000100:00100000:1.0:1789123165.189431:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381239808 00000100:00100000:1.0:1789123165.189487:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381239936 00000100:00100000:1.0:1789123165.189491:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381239936 00000100:00100000:1.0:1789123165.189537:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789123165.189546:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381239808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123165.189733:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789123165.189742:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381239936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123165.189786:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381239936:12345-0@lo:400:kworker.0 Request processed in 46us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123165.189802:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789123165.189845:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381239936:0@lo:400:kworker.0 00000100:00080000:2.0:1789123165.189879:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789123165.190057:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381239808:12345-0@lo:400:kworker.0 Request processed in 512us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123165.190064:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789123165.190183:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381239808:0@lo:400:kworker.0 00000100:00100000:0.0:1789123165.190292:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381240064:0@lo:400:kworker.0 00000100:00100000:0.0:1789123165.190330:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123165.190355:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789123165.190362:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3407d3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381239680:0@lo:400:kworker.0 00000100:00100000:0.0:1789123165.190389:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123165.190433:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b4bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876031381240192:0@lo:400:kworker.0 00000100:00100000:0.0:1789123165.190458:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123165.190499:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381240320 00000100:00100000:0.0:1789123165.190514:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381240320 00000100:00100000:0.0:1789123165.190549:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381240064 00000100:00100000:0.0:1789123165.190552:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381240064 00000100:00100000:0.0:1789123165.190571:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789123165.190590:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381240320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123165.190648:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381240320:12345-0@lo:400:kworker.0 Request processed in 59us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123165.190655:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789123165.190667:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789123165.190673:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381240064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123165.190714:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381240064:12345-0@lo:400:kworker.0 Request processed in 41us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123165.190719:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789123165.190746:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381240192 00000100:00100000:0.0:1789123165.190750:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381240192 00000100:00100000:0.0:1789123165.190773:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789123165.190778:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876031381240192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123165.190807:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876031381240192:12345-0@lo:400:kworker.0 Request processed in 29us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123165.190813:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789123165.190845:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b4bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876031381240192:0@lo:400:kworker.0 00010000:00080000:0.0:1789123165.190857:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3410b48780 x1876031381240064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123165.190866:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381240064:0@lo:400:kworker.0 00000100:00100000:2.0:1789123165.191218:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381239680 00000100:00100000:2.0:1789123165.191223:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381239680 00000100:00100000:2.0:1789123165.191270:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789123165.191278:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3304:x1876031381239680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123165.191321:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3304:x1876031381239680:12345-0@lo:400:kworker.0 Request processed in 44us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123165.191328:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00080000:2.0:1789123165.191358:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789123165.191363:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789123165.191365:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789123165.191383:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3407d3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381239680:0@lo:400:kworker.0 00000100:00100000:2.0:1789123165.191423:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381240320:0@lo:400:kworker.0 00000100:00100000:1.0:1789123165.194805:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f341848bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381240448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789123165.194882:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123165.195180:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381240448 00000100:00100000:0.0:1789123165.195189:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381240448 00000100:00100000:0.0:1789123165.195320:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789123165.195332:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d768b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381240448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789123165.195377:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789123165.195455:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d768b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381240448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123165.195462:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789123165.195604:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f341848bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381240448:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789123165.700904:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123166.724996:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789123166.725024:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381240576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789123166.725104:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123166.725317:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381240576 00000100:00100000:2.0:1789123166.725326:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381240576 00000100:00100000:2.0:1789123166.725387:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789123166.725397:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3404939680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381240576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789123166.725439:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123166.725515:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3404939680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381240576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123166.725522:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1789123166.725744:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3410b4b840 x1876031381240576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123166.725784:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381240576:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789123166.726290:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123167.749212:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123168.156559:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123168.156600:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123168.156699:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364425856 00000100:00100000:1.0:1789123168.156709:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364425856 00000100:00100000:1.0:1789123168.156818:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 126 00000100:00100000:0.0:1789123168.156823:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364425728 00000100:00100000:0.0:1789123168.156829:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364425728 00000100:00100000:1.0:1789123168.156831:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2352:x1876031364425856:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123168.156864:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 307 00000100:00100000:0.0:1789123168.156873:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+13:2352:x1876031364425728:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123168.156926:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2352:x1876031364425856:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 96us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123168.156927:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+13:2352:x1876031364425728:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 53us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123168.156946:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 307 00000100:00100000:1.0:1789123168.156948:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 126 00000100:00080000:2.0:1789123168.157697:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789123168.170418:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123168.170993:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364425984 00000100:00100000:0.0:1789123168.171003:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364425984 00000100:00100000:0.0:1789123168.171093:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 19 00000100:00100000:0.0:1789123168.171105:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3404939e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2351:x1876031364425984:12345-192.168.206.30@tcp:9:kworker.0 00000020:00000080:0.0:1789123168.171138:0:6688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc91ce0 00000100:00080000:0.0:1789123168.171147:0:6688:0:(import.c:65:import_set_state_nolock()) ffff9f34184dc800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789123168.171197:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1789123168.171481:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3404939e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+2:2351:x1876031364425984:12345-192.168.206.30@tcp:9:kworker.0 Request processed in 379us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123168.172985:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 19 00000100:00080000:2.0:1789123168.174411:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789123168.175356:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123168.203066:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123168.204613:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364426112 00000100:00100000:2.0:1789123168.204660:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364426112 00000100:00100000:2.0:1789123168.204819:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 127 00000100:00100000:2.0:1789123168.204832:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d769680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2352:x1876031364426112:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1789123168.205140:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d769680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2352:x1876031364426112:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 309us (2085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123168.205148:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 127 00000100:00080000:0.0:1789123168.205206:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789123168.779532:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123169.799572:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123170.308812:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789123170.308840:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381240704:0@lo:400:kworker.0 00000100:00100000:2.0:1789123170.308874:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381240832:0@lo:400:kworker.0 00000100:00100000:0.0:1789123170.308928:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123170.309036:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381241216:0@lo:400:kworker.0 00000100:00100000:2.0:1789123170.309117:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123170.309165:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381241344:0@lo:400:kworker.0 00000100:00100000:2.0:1789123170.309192:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123170.309219:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789123170.309225:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381240960:0@lo:400:kworker.0 00000100:00100000:2.0:1789123170.309248:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123170.309295:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381240832 00000100:00100000:2.0:1789123170.309302:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381240832 00000100:00100000:2.0:1789123170.309339:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381240960 00000100:00100000:2.0:1789123170.309343:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381240960 00000100:00100000:2.0:1789123170.309370:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789123170.309378:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381240832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123170.309427:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381240832:12345-0@lo:400:kworker.0 Request processed in 49us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123170.309436:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789123170.309452:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789123170.309921:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381240960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123170.309970:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381240960:12345-0@lo:400:kworker.0 Request processed in 54us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123170.309977:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789123170.310002:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381241344 00000100:00100000:2.0:1789123170.310007:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381241344 00000100:00100000:2.0:1789123170.310036:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789123170.310042:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b4a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381241344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123170.310074:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b4a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381241344:12345-0@lo:400:kworker.0 Request processed in 32us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123170.310081:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1789123170.310103:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789123170.310107:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789123170.310143:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381240960:0@lo:400:kworker.0 00000100:00100000:2.0:1789123170.310155:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381240832:0@lo:400:kworker.0 00000100:00100000:2.0:1789123170.310165:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381241344:0@lo:400:kworker.0 00000100:00100000:2.0:1789123170.310268:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381241472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789123170.310312:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123170.310348:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381241472 00000100:00100000:2.0:1789123170.310353:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381241472 00000100:00100000:2.0:1789123170.310377:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789123170.310384:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b49a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381241472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789123170.310409:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123170.310444:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b49a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381241472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123170.310450:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789123170.310979:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381241472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789123170.311269:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381240704 00000100:00100000:2.0:1789123170.311274:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381240704 00000100:00100000:2.0:1789123170.311306:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1789123170.311314:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3304:x1876031381240704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123170.311359:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3304:x1876031381240704:12345-0@lo:400:kworker.0 Request processed in 46us (2431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123170.311365:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789123170.315054:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381240704:0@lo:400:kworker.0 00000100:00100000:0.0:1789123170.315106:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b49680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381241088:0@lo:400:kworker.0 00000100:00100000:0.0:1789123170.315177:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123170.315538:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123170.315715:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381241216 00000100:00100000:3.0:1789123170.315722:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381241216 00000100:00100000:3.0:1789123170.315790:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789123170.315799:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d7683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876031381241216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123170.315858:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d7683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876031381241216:12345-0@lo:400:kworker.0 Request processed in 59us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123170.315866:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789123170.315904:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381241216:0@lo:400:kworker.0 00000100:00080000:1.0:1789123170.315961:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789123170.316941:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381241088 00000100:00100000:2.0:1789123170.316952:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381241088 00000100:00080000:1.0:1789123170.316993:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789123170.317016:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789123170.317027:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f341848bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381241088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123170.317104:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f341848bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381241088:12345-0@lo:400:kworker.0 Request processed in 79us (1927us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123170.317113:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1789123170.317143:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f3410b49680 x1876031381241088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123170.317158:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b49680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381241088:0@lo:400:kworker.0 00010000:00010000:3.0:1789123170.822748:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789123170.899926:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 64de9449-4320-4c9f-abcb-230edd2b11ae 00000020:00000080:0.0:1789123170.899951:0:7644:0:(genops.c:885:class_export_put()) final put ffff9f34184d8800/64de9449-4320-4c9f-abcb-230edd2b11ae 00000020:00000080:0.0:1789123170.900744:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9f34184d8800/64de9449-4320-4c9f-abcb-230edd2b11ae for lustre-OST0001 00000020:00000080:0.0:1789123170.907731:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f34184dc800 for lustre-OST0001 00010000:00010000:1.0:1789123171.846068:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123171.846163:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789123171.846187:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184c8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381241600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789123171.846250:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123171.846308:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381241600 00000100:00100000:0.0:1789123171.846315:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381241600 00000100:00100000:0.0:1789123171.846360:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789123171.846367:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184cb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381241600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789123171.846410:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789123171.846450:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184cb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381241600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123171.846456:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1789123171.846515:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34184c8780 x1876031381241600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123171.846532:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184c8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381241600:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789123172.869802:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789123172.933300:0:12081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789123173.274511:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123173.274555:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123173.274600:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123173.274654:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364426496 00000100:00100000:1.0:1789123173.274663:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364426496 00000100:00100000:1.0:1789123173.274718:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364426368 00000100:00100000:1.0:1789123173.274721:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364426368 00000100:00100000:1.0:1789123173.274744:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 131 00000100:00100000:1.0:1789123173.274753:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d769e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2353:x1876031364426496:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123173.274814:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d769e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2353:x1876031364426496:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 61us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123173.274835:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 131 00000100:00100000:1.0:1789123173.274850:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 132 00000100:00100000:1.0:1789123173.274856:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2353:x1876031364426368:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123173.274877:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2353:x1876031364426368:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 21us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123173.274882:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 132 00000100:00080000:1.0:1789123173.274896:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789123173.275115:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364426240 00000100:00100000:2.0:1789123173.275119:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364426240 00000100:00100000:2.0:1789123173.275154:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 309 00000100:00100000:2.0:1789123173.275160:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+13:2353:x1876031364426240:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1789123173.275187:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+13:2353:x1876031364426240:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 27us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123173.275193:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 309 00000001:02000400:2.0:1789123173.781152:0:12245:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 06:39:32 (1789123172) 00010000:00010000:1.0:1789123173.895006:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123174.917021:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123175.430566:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d7692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381242112:0@lo:400:kworker.0 00000100:00100000:2.0:1789123175.430578:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d76b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381241856:0@lo:400:kworker.0 00000100:00100000:0.0:1789123175.430705:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d76a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381241728:0@lo:400:kworker.0 00000100:00100000:3.0:1789123175.430743:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d76a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876031381241984:0@lo:400:kworker.0 00000100:00100000:2.0:1789123175.432116:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123175.432213:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d76b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381242368:0@lo:400:kworker.0 00000100:00100000:2.0:1789123175.432256:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123175.432315:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381241856 00000100:00100000:2.0:1789123175.432323:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381241856 00000100:00100000:2.0:1789123175.432371:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789123175.432380:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381241856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123175.432457:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381241856:12345-0@lo:400:kworker.0 Request processed in 57us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123175.432465:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789123175.432493:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381242368 00000100:00100000:2.0:1789123175.432497:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381242368 00000100:00100000:2.0:1789123175.432531:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789123175.432536:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381242368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123175.432759:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381242368:12345-0@lo:400:kworker.0 Request processed in 222us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123175.432767:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789123175.432808:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d76b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381241856:0@lo:400:kworker.0 00000100:00100000:2.0:1789123175.432819:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d76b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381242368:0@lo:400:kworker.0 00000100:00080000:2.0:1789123175.432906:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789123175.436604:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123175.436730:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381242112 00000100:00100000:1.0:1789123175.436739:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381242112 00000100:00100000:1.0:1789123175.436804:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789123175.436829:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d768780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381242112:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789123175.436871:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789123175.436909:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d768780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381242112:12345-0@lo:400:kworker.0 Request processed in 96us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123175.436917:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1789123175.436934:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f342d7692c0 x1876031381242112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789123191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123175.436951:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d7692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381242112:0@lo:400:kworker.0 00000100:00100000:0.0:1789123175.441045:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123175.443053:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123175.443348:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f340493a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381242496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789123175.443391:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123175.443441:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381242496 00000100:00100000:3.0:1789123175.443460:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381242496 00000100:00100000:3.0:1789123175.443505:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789123175.443515:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340493a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381242496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789123175.443550:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789123175.443611:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d76b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381242240:0@lo:400:kworker.0 00000100:00100000:0.0:1789123175.443661:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123175.443712:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381241984 00000100:00100000:0.0:1789123175.443716:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381241984 00000100:00100000:0.0:1789123175.443751:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381242240 00000100:00100000:0.0:1789123175.443754:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381242240 00000100:00100000:0.0:1789123175.443788:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789123175.443795:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340493b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876031381241984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123175.447535:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381241728 00000100:00100000:2.0:1789123175.447550:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381241728 00000100:00100000:2.0:1789123175.447639:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1789123175.447667:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3305:x1876031381241728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123175.447770:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3305:x1876031381241728:12345-0@lo:400:kworker.0 Request processed in 105us (6732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123175.447777:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1789123175.449333:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789123175.449357:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876031381242240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123175.449437:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876031381242240:12345-0@lo:400:kworker.0 Request processed in 91us (5774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123175.449444:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:1.0:1789123175.449743:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789123175.449793:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d76a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381241728:0@lo:400:kworker.0 00000100:00100000:1.0:1789123175.449842:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d76b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381242240:0@lo:400:kworker.0 00000100:00100000:3.0:1789123175.456537:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340493a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381242496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 13014us (13135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123175.456552:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789123175.456712:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340493b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876031381241984:12345-0@lo:400:kworker.0 Request processed in 12915us (13663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123175.456721:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789123175.469445:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d76a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876031381241984:0@lo:400:kworker.0 00000100:00100000:2.0:1789123175.469487:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f340493a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381242496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789123175.770828:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123175.771177:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364426624 00000100:00100000:3.0:1789123175.771195:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364426624 00000100:00080000:1.0:1789123175.771300:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789123175.771306:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 32 00000100:00100000:3.0:1789123175.771324:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d76b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+5:10443:x1876031364426624:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789123175.771418:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123175.771462:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3600/0x7e1648d68fc91dab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f55e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.771934:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91db2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.771955:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91db2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.771971:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91db2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123175.773484:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789123175.773497:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789123175.774064:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91db2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.774122:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3600/0x7e1648d68fc91dab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f55e expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.774148:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91db2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f55e expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.774158:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f3411751a00) 00010000:00010000:3.0:1789123175.774162:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789123175.774166:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f34029f3200, rc 0) 00000100:00100000:3.0:1789123175.774263:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d76b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+6:10443:x1876031364426624:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 2945us (3446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123175.774274:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 32 00000100:00100000:1.0:1789123175.785139:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123175.785256:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364426752 00000100:00100000:2.0:1789123175.785272:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364426752 00000100:00100000:2.0:1789123175.785356:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 33 00000100:00100000:2.0:1789123175.785367:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d76a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+6:10444:x1876031364426752:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789123175.785390:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123175.785423:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc91db9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f565 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123175.785522:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc91dc0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123175.785537:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc91dc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123175.785547:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc91dc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123175.785561:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc91dc7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123175.785568:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc91dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123175.785607:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc91dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123175.786031:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80be00/0x7e1648d68fc91dce lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123175.786041:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80be00/0x7e1648d68fc91dce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123175.786048:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80be00/0x7e1648d68fc91dce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123175.786134:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1789123175.786138:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1789123175.786219:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80be00/0x7e1648d68fc91dce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123175.786231:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc91dc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123175.786238:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc91dc0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123175.786245:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc91dc0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123175.786251:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123175.786255:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc91dc0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123175.786264:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc91dc0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123175.786282:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f3411751a00) 00010000:00010000:2.0:1789123175.786285:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123175.786290:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc91dc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123175.786297:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc91dc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123175.786309:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc91dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123175.786316:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc91dc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123175.786322:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc91dc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123175.786327:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80aa00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123175.786330:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc91dc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123175.786336:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc91dc7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123175.786343:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9f34232f7f00) 00010000:00010000:2.0:1789123175.786346:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123175.786349:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc91dc7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123175.786355:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc91dc7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123175.786398:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc91db9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f565 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123175.786412:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80be00/0x7e1648d68fc91dce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f565 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123175.786420:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f34232f7a00) 00010000:00010000:2.0:1789123175.786422:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789123175.786424:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80be00, rc 0) 00000100:00100000:2.0:1789123175.786513:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d76a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+7:10444:x1876031364426752:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 1147us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123175.786521:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 33 00000100:00100000:1.0:1789123175.794058:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123175.794707:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364427008 00000100:00100000:3.0:1789123175.794716:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364427008 00000100:00100000:3.0:1789123175.794823:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 34 00000100:00100000:3.0:1789123175.794833:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d76a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+7:10444:x1876031364427008:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789123175.794853:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123175.794875:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3600/0x7e1648d68fc91dd5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f56c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.794955:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91ddc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.794970:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91ddc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.795002:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91ddc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.795445:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc91de3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.795466:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc91de3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.795474:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc91de3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.796124:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514000/0x7e1648d68fc91dea lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.796206:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514000/0x7e1648d68fc91dea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.796215:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514000/0x7e1648d68fc91dea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123175.796226:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1789123175.796424:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91ddc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.796432:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91ddc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.796439:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91ddc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.796446:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34029f2e00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123175.796470:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91ddc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.796479:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91ddc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.796492:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f34232f7a00) 00010000:00010000:3.0:1789123175.796495:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123175.796500:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91ddc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.796507:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91ddc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.796522:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc91de3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.796528:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc91de3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.796534:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc91de3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.796540:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401514e00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123175.796543:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc91de3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.796550:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc91de3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.796557:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9f3411751300) 00010000:00010000:3.0:1789123175.796560:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123175.796569:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc91de3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.796575:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc91de3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.796965:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3600/0x7e1648d68fc91dd5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f56c expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.796982:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514000/0x7e1648d68fc91dea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f56c expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123175.796990:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f3411751e00) 00010000:00010000:3.0:1789123175.796993:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123175.796996:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3401514000, rc 0) 00000100:00100000:3.0:1789123175.797071:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d76a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+9:10444:x1876031364427008:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 2239us (3021us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789123175.797080:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 34 00000100:00100000:1.0:1789123175.801328:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123175.801426:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364427136 00000100:00100000:0.0:1789123175.801436:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364427136 00000100:00100000:0.0:1789123175.801507:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 35 00000100:00100000:0.0:1789123175.801531:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d7692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+9:10444:x1876031364427136:12345-192.168.206.30@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789123175.801677:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d7692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+9:10444:x1876031364427136:12345-192.168.206.30@tcp:59:lhsmtool_posix.0 Request processed in 161us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123175.801686:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 35 00010000:00010000:1.0:1789123175.941973:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789123176.005405:0:12081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789123176.966538:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381242624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789123176.966657:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123176.966729:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381242624 00000100:00100000:1.0:1789123176.966737:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381242624 00000100:00100000:1.0:1789123176.966800:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789123176.966810:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d76b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381242624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789123176.967021:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00010000:3.0:1789123176.967033:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123176.967076:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d76b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381242624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 267us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123176.967084:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1789123176.967104:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34184ca940 x1876031381242624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123176.967124:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381242624:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789123177.994690:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123178.376591:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123178.376810:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364427264 00000100:00100000:1.0:1789123178.376821:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364427264 00000100:00100000:1.0:1789123178.376889:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 36 00000100:00100000:1.0:1789123178.376900:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+9:10487:x1876031364427264:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1789123178.376921:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123178.376962:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc91df8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f573 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.377055:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc91dff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.377070:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc91dff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.377082:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc91dff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.377098:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91e06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.377105:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91e06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.377113:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91e06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.377451:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc91dff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.377460:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc91dff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.377467:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc91dff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.377474:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123178.377478:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc91dff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.377495:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc91dff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.377509:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f3411751a00) 00010000:00010000:1.0:1789123178.377512:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123178.377517:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc91dff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.377523:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc91dff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.377535:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91e06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.377540:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91e06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.377546:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91e06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.377551:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33000 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123178.377554:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91e06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.377560:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91e06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.377567:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9f340534d800) 00010000:00010000:1.0:1789123178.377678:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123178.377684:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91e06 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.377700:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91e06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.377735:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc91df8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f573 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.377745:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f3411751a00) 00010000:00010000:1.0:1789123178.377748:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123178.377751:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc91df8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f573 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.377759:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd33200, rc 0) 00000100:00100000:1.0:1789123178.377822:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+9:10487:x1876031364427264:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 923us (1239us total) trans 0 rc 301/301 00000100:00100000:1.0:1789123178.377830:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 36 00000100:00080000:2.0:1789123178.380140:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789123178.382946:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123178.383025:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364427520 00000100:00100000:2.0:1789123178.383034:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364427520 00000100:00100000:2.0:1789123178.383094:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 37 00000100:00100000:2.0:1789123178.383104:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d76b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+9:10487:x1876031364427520:12345-192.168.206.30@tcp:36:lfs.0 00010000:00010000:2.0:1789123178.383162:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123178.383189:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91db2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f55e expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123178.383212:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f3411751a00) 00010000:00010000:2.0:1789123178.383224:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789123178.383554:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91e0d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123178.383586:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91e0d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123178.383597:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91e0d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123178.383612:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc91e14 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123178.383619:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc91e14 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123178.383651:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc91e14 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123178.384725:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1789123178.384740:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91e0d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123178.384749:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91e0d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123178.384756:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91e0d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123178.384762:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123178.384767:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91e0d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123178.384775:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91e0d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123178.384800:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34232f7f00) 00010000:00010000:2.0:1789123178.384803:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123178.384808:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91e0d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123178.384814:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91e0d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789123178.384831:0:5840:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f4a28c36 reply state 000000003804bb8f transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc91e14 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123178.384839:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789123178.384956:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d76b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+10:10487:x1876031364427520:12345-192.168.206.30@tcp:36:lfs.0 Request processed in 1850us (2016us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789123178.384965:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 37 00010000:00010000:0.0:1789123178.390759:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc91e14 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123178.390776:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc91e14 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123178.390783:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc91e14 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123178.390790:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80b600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123178.390794:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc91e14 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123178.390821:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc91e14 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123178.390838:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9f34232f7100) 00010000:00010000:0.0:1789123178.390841:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123178.390846:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc91e14 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123178.390852:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc91e14 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123178.397571:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123178.397689:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123178.397720:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364427776 00000100:00100000:1.0:1789123178.397728:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364427776 00000100:00100000:1.0:1789123178.397791:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 136 00000100:00100000:1.0:1789123178.397801:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3418488b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2352:x1876031364427776:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123178.397866:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3418488b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2352:x1876031364427776:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 67us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123178.397873:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 136 00000100:00080000:1.0:1789123178.397949:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789123178.398090:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364427648 00000100:00100000:3.0:1789123178.398095:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364427648 00000100:00100000:3.0:1789123178.398287:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 311 00000100:00100000:3.0:1789123178.398296:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+13:2352:x1876031364427648:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1789123178.398333:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+13:2352:x1876031364427648:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 38us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123178.398340:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 311 00000100:00100000:1.0:1789123178.528893:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123178.529581:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364427904 00000100:00100000:2.0:1789123178.529593:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364427904 00000100:00100000:2.0:1789123178.529698:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 38 00000100:00100000:2.0:1789123178.529709:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+9:10495:x1876031364427904:12345-192.168.206.30@tcp:101:lctl.0 00010000:00010000:2.0:1789123178.529733:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123178.529765:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc91e1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f57a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123178.529837:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc91e22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123178.529851:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc91e22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123178.529888:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc91e22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123178.529952:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789123178.529955:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1789123178.530000:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc91e22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123178.530026:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc91e1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f57a expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123178.530047:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc91e22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f57a expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123178.530057:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34232f7f00) 00010000:00010000:2.0:1789123178.530060:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789123178.530202:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80ac00, rc 0) 00000100:00100000:2.0:1789123178.530350:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+10:10495:x1876031364427904:12345-192.168.206.30@tcp:101:lctl.0 Request processed in 641us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123178.530358:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 38 00000100:00100000:3.0:1789123178.615590:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123178.615839:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364428032 00000100:00100000:1.0:1789123178.615848:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364428032 00000100:00100000:1.0:1789123178.615911:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 39 00000100:00100000:1.0:1789123178.615920:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340493b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+10:10501:x1876031364428032:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:1.0:1789123178.615939:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123178.615959:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc91e29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f581 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.616019:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91e30 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.616033:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91e30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.616044:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91e30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.616059:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc91e37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.616078:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc91e37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.616085:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc91e37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.616199:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33600/0x7e1648d68fc91e3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.616208:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33600/0x7e1648d68fc91e3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.616236:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33600/0x7e1648d68fc91e3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123178.616269:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1789123178.616273:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789123178.616315:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33600/0x7e1648d68fc91e3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.616339:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91e30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.616346:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91e30 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.616353:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91e30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.616359:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33000 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123178.616363:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91e30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.616370:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91e30 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.616382:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34232f7f00) 00010000:00010000:1.0:1789123178.616385:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123178.616390:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91e30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.616396:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91e30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.616421:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc91e37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.616445:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc91e37 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.616451:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc91e37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.616456:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123178.616459:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc91e37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.616464:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc91e37 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.616472:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9f340534d800) 00010000:00010000:1.0:1789123178.616475:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123178.616478:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc91e37 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.616484:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc91e37 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.616514:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc91e29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f581 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.616527:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33600/0x7e1648d68fc91e3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f581 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.616546:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:1.0:1789123178.616548:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789123178.616551:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd33600, rc 0) 00000100:00100000:1.0:1789123178.616619:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340493b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+11:10501:x1876031364428032:12345-192.168.206.30@tcp:101:bash.0 Request processed in 699us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123178.616681:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 39 00000100:00100000:0.0:1789123178.621540:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123178.621687:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364428288 00000100:00100000:3.0:1789123178.621712:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364428288 00000100:00100000:3.0:1789123178.621778:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 40 00000100:00100000:3.0:1789123178.621787:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+11:10501:x1876031364428288:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:3.0:1789123178.621804:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123178.621824:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3600/0x7e1648d68fc91e45 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f588 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123178.621949:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91e4c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123178.621962:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91e4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123178.621971:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91e4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123178.622032:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91e53 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123178.622041:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91e53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123178.622060:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91e53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789123178.622863:0:7640:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1789123178.623032:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc91e5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123178.623044:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc91e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123178.623064:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc91e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123178.623101:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91e4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123178.623107:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91e4c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123178.623114:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91e4c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123178.623120:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34029f2e00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123178.623124:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91e4c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123178.623131:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91e4c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123178.623143:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:3.0:1789123178.623146:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123178.623151:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91e4c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123178.623157:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91e4c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789123178.623170:0:7640:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000077f577c0 reply state 00000000ee22960a transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91e53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123178.623179:0:7640:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789123178.623215:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3600/0x7e1648d68fc91e45 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f588 expref: 14 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123178.623231:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc91e5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f588 expref: 13 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123178.623238:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f3411751800) 00010000:00010000:3.0:1789123178.623240:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789123178.623243:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3401514e00, rc 0) 00000100:00100000:3.0:1789123178.623318:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+14:10501:x1876031364428288:12345-192.168.206.30@tcp:101:bash.0 Request processed in 1531us (1788us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789123178.624746:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 40 00010000:00010000:0.0:1789123178.626792:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91e53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123178.626808:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91e53 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123178.626816:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91e53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123178.626822:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34029f3200 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123178.626826:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91e53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123178.626835:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91e53 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123178.626851:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f3411751400) 00010000:00010000:0.0:1789123178.626854:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123178.626877:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91e53 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123178.626883:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91e53 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123178.631345:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123178.631784:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364428416 00000100:00100000:2.0:1789123178.631794:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364428416 00000100:00100000:2.0:1789123178.631846:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 20 00000100:00100000:2.0:1789123178.631854:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1876031364428416:12345-192.168.206.30@tcp:8:bash.0 00010000:00080000:2.0:1789123178.631887:0:8519:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 64de9449-4320-4c9f-abcb-230edd2b11ae@192.168.206.30@tcp t0 exp 0000000000000000 cur 292 last 0 00000020:00000080:2.0:1789123178.631918:0:8519:0:(genops.c:1385:class_connect()) connect: client 64de9449-4320-4c9f-abcb-230edd2b11ae, cookie 0x7e1648d68fc91e68 00002000:00100000:2.0:1789123178.631930:0:8519:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 64de9449-4320-4c9f-abcb-230edd2b11ae/ffff9f343bd28000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398a ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789123178.631958:0:8519:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789123178.632197:0:8519:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789123178.632231:0:8519:0:(import.c:65:import_set_state_nolock()) ffff9f343bd2b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789123178.633209:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2351:x1876031364428416:12345-192.168.206.30@tcp:8:bash.0 Request processed in 1348us (1867us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123178.633221:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 20 00000100:00100000:2.0:1789123178.637705:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123178.637900:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364428544 00000100:00100000:0.0:1789123178.637909:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364428544 00000100:00100000:0.0:1789123178.637996:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 21 00000100:00100000:0.0:1789123178.638006:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b49680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+6:0:x1876031364428544:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:0.0:1789123178.638023:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123178.638045:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ada751f/0x7e1648d68fc91e6f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f58f expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789123178.638073:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789123178.638090:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=292s v=(0 0) 00010000:00010000:0.0:1789123178.638095:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123178.638104:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ada751f/0x7e1648d68fc91e6f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f58f expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123178.638124:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008ada751f/0x7e1648d68fc91e6f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f58f expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123178.638138:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b52600, rc 0) 00000100:00100000:0.0:1789123178.638199:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b49680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+7:0:x1876031364428544:12345-192.168.206.30@tcp:101:bash.0 Request processed in 194us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123178.638206:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 21 00000100:00080000:1.0:1789123178.638869:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789123178.642041:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123178.642265:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364428672 00000100:00100000:0.0:1789123178.642275:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364428672 00000100:00100000:0.0:1789123178.642345:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 22 00000100:00100000:0.0:1789123178.642355:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+7:10501:x1876031364428672:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:0.0:1789123178.642372:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123178.642389:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e74ed8fc/0x7e1648d68fc91e76 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f596 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123178.642428:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ada751f/0x7e1648d68fc91e6f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f58f expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123178.642447:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123178.642451:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123178.642457:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e74ed8fc/0x7e1648d68fc91e76 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f596 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123178.642488:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ada751f/0x7e1648d68fc91e6f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f58f expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123178.642502:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ada751f/0x7e1648d68fc91e6f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f58f expref: 8 pid: 6686 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123178.642517:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1876031381242752:192.168.206.30@tcp:104: 00000100:00100000:0.0:1789123178.642608:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3402be29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789123178.646217:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123178.646373:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364428800 00000100:00100000:2.0:1789123178.646382:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364428800 00010000:00010000:2.0:1789123178.646442:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ada751f/0x7e1648d68fc91e6f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f58f expref: 9 pid: 6686 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123178.646483:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 40 00000100:00100000:2.0:1789123178.646493:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340493a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+9:2355:x1876031364428800:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789123178.646510:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123178.646533:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008ada751f/0x7e1648d68fc91e6f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f58f expref: 9 pid: 6686 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123178.646546:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008ada751f/0x7e1648d68fc91e6f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f58f expref: 9 pid: 6686 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123178.646571:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789123178.646576:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789123178.646584:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e74ed8fc/0x7e1648d68fc91e76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f596 expref: 9 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123178.646616:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e74ed8fc/0x7e1648d68fc91e76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f596 expref: 9 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123178.646695:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e74ed8fc/0x7e1648d68fc91e76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f596 expref: 9 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123178.646711:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b483c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1876031381242880:192.168.206.30@tcp:105: 00000100:00100000:2.0:1789123178.646799:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410be0e40 going to sleep for 11 seconds 00010000:00010000:0.0:1789123178.647475:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ada751f/0x7e1648d68fc91e6f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f58f expref: 9 pid: 6686 timeout: 392 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123178.647508:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1876031381242752:192.168.206.30@tcp:104: 00010000:00010000:0.0:1789123178.647531:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e74ed8fc/0x7e1648d68fc91e76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f596 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123178.647543:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53a00, rc 0) 00000100:00100000:0.0:1789123178.647591:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+8:10501:x1876031364428672:12345-192.168.206.30@tcp:101:bash.0 Request processed in 5237us (5557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123178.647599:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 22 00000100:00100000:3.0:1789123178.652590:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123178.652720:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364429056 00000100:00100000:0.0:1789123178.652728:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364429056 00000100:00100000:0.0:1789123178.652789:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 6 00000100:00100000:0.0:1789123178.652799:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3404938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+13:10501:x1876031364429056:12345-192.168.206.30@tcp:35:bash.0 00000100:00100000:0.0:1789123178.653180:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3404938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+14:10501:x1876031364429056:12345-192.168.206.30@tcp:35:bash.0 Request processed in 381us (597us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789123178.653188:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 6 00000100:00100000:2.0:1789123178.654134:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b483c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1876031381242880:192.168.206.30@tcp:105: 00010000:00010000:2.0:1789123178.654163:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123178.654217:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340493a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2355:x1876031364428800:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 7725us (8008us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123178.654226:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 40 00000100:00100000:3.0:1789123178.845973:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123178.846356:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364429312 00000100:00100000:1.0:1789123178.846367:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364429312 00000100:00100000:1.0:1789123178.846446:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 41 00000100:00100000:1.0:1789123178.846457:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3404938f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+14:10511:x1876031364429312:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1789123178.846486:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123178.846507:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91e7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f59d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123178.846663:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1789123178.846792:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91e7d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f59d expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.846807:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34232f7f00) 00010000:00010000:1.0:1789123178.846838:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789123178.846844:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91e7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f59d expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123178.846859:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd33c00, rc 0) 00000100:00100000:1.0:1789123178.846927:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3404938f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+15:10511:x1876031364429312:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 472us (966us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1789123178.846964:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 41 00000100:00100000:1.0:1789123178.853667:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123178.853752:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364429568 00000100:00100000:0.0:1789123178.853762:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364429568 00000100:00100000:0.0:1789123178.853825:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:0.0:1789123178.853836:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+15:10511:x1876031364429568:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:0.0:1789123178.854139:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+16:10511:x1876031364429568:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 304us (516us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789123178.854147:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 7 00010000:00010000:3.0:1789123179.014055:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123179.016770:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123179.017584:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364429696 00000100:00100000:2.0:1789123179.017596:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364429696 00000100:00100000:2.0:1789123179.017697:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 42 00000100:00100000:2.0:1789123179.017708:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+16:10517:x1876031364429696:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1789123179.017733:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123179.017771:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91e8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f5a4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123179.017959:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc91e92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123179.017974:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc91e92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123179.017999:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc91e92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123179.018178:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1789123179.018182:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789123179.018209:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc91e92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123179.020279:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91e8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5a4 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123179.020319:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc91e92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5a4 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123179.021575:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:2.0:1789123179.021580:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789123179.021584:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80b600, rc 0) 00000100:00100000:2.0:1789123179.021692:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+17:10517:x1876031364429696:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 3983us (4929us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123179.021701:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 42 00000100:00100000:3.0:1789123179.028023:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123179.028677:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364429952 00000100:00100000:0.0:1789123179.028696:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364429952 00000100:00100000:0.0:1789123179.028761:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 43 00000100:00100000:0.0:1789123179.028771:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343fc07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+17:10517:x1876031364429952:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:0.0:1789123179.028790:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123179.028809:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc91e99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f5ab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123179.029081:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc91ea0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123179.029098:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc91ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123179.029360:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc91ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123179.029375:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789123179.029535:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc91e99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5ab expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123179.029556:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc91ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5ab expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123179.029564:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f3411751800) 00010000:00010000:0.0:1789123179.029567:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789123179.029570:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b52c00, rc 0) 00000100:00100000:0.0:1789123179.029693:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343fc07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+19:10517:x1876031364429952:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 923us (1677us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789123179.029702:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 43 00000100:00100000:1.0:1789123179.035581:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123179.035799:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364430208 00000100:00100000:3.0:1789123179.035813:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364430208 00000100:00100000:3.0:1789123179.035873:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 44 00000100:00100000:3.0:1789123179.035883:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+19:10517:x1876031364430208:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:3.0:1789123179.035909:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123179.035931:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3600/0x7e1648d68fc91eae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f5b2 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123179.036019:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91eb5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123179.036200:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91eb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123179.036213:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91eb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123179.036228:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789123179.038028:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3600/0x7e1648d68fc91eae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5b2 expref: 22 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123179.038872:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91eb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5b2 expref: 21 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123179.038883:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f3411751800) 00010000:00010000:3.0:1789123179.038886:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789123179.038890:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f34029f2e00, rc 0) 00000100:00100000:3.0:1789123179.039055:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+21:10517:x1876031364430208:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 3171us (3481us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789123179.039064:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 44 00000100:00100000:0.0:1789123179.041468:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123179.045949:0:11614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364430336 00000100:00100000:1.0:1789123179.045964:0:11614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364430336 00000100:00100000:1.0:1789123179.046671:0:11614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 2 00000100:00100000:1.0:1789123179.046689:0:11614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+21:2352:x1876031364430336:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789123179.046710:0:11614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123179.046735:0:11614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc91ea0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5ab expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.046765:0:11614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f3411751800) 00010000:00010000:1.0:1789123179.046770:0:11614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789123179.046838:0:11614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+20:2352:x1876031364430336:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 155us (5379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123179.052382:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123179.052574:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364430464 00000100:00100000:0.0:1789123179.052584:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364430464 00000100:00100000:0.0:1789123179.052679:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 23 00000100:00100000:0.0:1789123179.052690:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343fc07840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2355:x1876031364430464:12345-192.168.206.30@tcp:1:lfs.0 00010000:00010000:0.0:1789123179.052736:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb244ecb/0x7e1648d68fc91ec3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123179.052766:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e74ed8fc/0x7e1648d68fc91e76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f596 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123179.052774:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789123179.052779:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789123179.052783:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb244ecb/0x7e1648d68fc91ec3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123179.052820:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e74ed8fc/0x7e1648d68fc91e76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f596 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123179.052833:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e74ed8fc/0x7e1648d68fc91e76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f596 expref: 7 pid: 6687 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123179.052847:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343568fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1876031381243008:192.168.206.30@tcp:104: 00000100:00100000:0.0:1789123179.052937:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3402be2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123179.059279:0:11614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 2 00000100:00100000:2.0:1789123179.060048:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343568fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1876031381243008:192.168.206.30@tcp:104: 00010000:00010000:2.0:1789123179.060073:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eb244ecb/0x7e1648d68fc91ec3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123179.062484:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123179.062860:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364430592 00000100:00100000:1.0:1789123179.062871:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364430592 00002000:00100000:1.0:1789123179.062919:0:6691:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9f343fc06d00 x1876031364430592/t0(0) o4->64de9449-4320-4c9f-abcb-230edd2b11ae@192.168.206.30@tcp:445/0 lens 504/0 e 0 to 0 dl 1789123190 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789123179.062929:0:6691:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9f343fc06d00 with x1876031364430592 ext(0->12) 00010000:00010000:1.0:1789123179.062939:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e74ed8fc/0x7e1648d68fc91e76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f596 expref: 8 pid: 6687 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.062955:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e74ed8fc/0x7e1648d68fc91e76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f596 expref: 8 pid: 6687 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789123179.062984:0:6691:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9f343fc06d00 00000100:00100000:1.0:1789123179.063013:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 0 00000100:00100000:1.0:1789123179.063023:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343fc06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+8:2354:x1876031364430592:12345-192.168.206.30@tcp:4:lfs.0 00000001:00100000:2.0:1789123179.161309:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 64de9449-4320-4c9f-abcb-230edd2b11ae 00000100:00100000:1.0:1789123179.162023:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343fc06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+9:2354:x1876031364430592:12345-192.168.206.30@tcp:4:lfs.0 Request processed in 98995us (99546us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789123179.162110:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 0 00002000:00100000:1.0:1789123179.162127:0:6691:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9f343fc06d00 x1876031364430592/t4294967299(0) o4->64de9449-4320-4c9f-abcb-230edd2b11ae@192.168.206.30@tcp:445/0 lens 504/448 e 0 to 0 dl 1789123190 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789123179.162138:0:6691:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9f343fc06d00 with x1876031364430592 ext(0->12) 00010000:00010000:1.0:1789123179.162151:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e74ed8fc/0x7e1648d68fc91e76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f596 expref: 9 pid: 6687 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.162170:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e74ed8fc/0x7e1648d68fc91e76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f596 expref: 9 pid: 6687 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789123179.162178:0:6691:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9f343fc06d00 00000100:00100000:1.0:1789123179.173680:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123179.173848:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364430720 00000100:00100000:3.0:1789123179.173857:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364430720 00010000:00010000:3.0:1789123179.173907:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e74ed8fc/0x7e1648d68fc91e76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f596 expref: 9 pid: 6687 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123179.173954:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 41 00000100:00100000:3.0:1789123179.173964:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+9:2355:x1876031364430720:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789123179.174002:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789123179.174027:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789123179.174030:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789123178 00002000:00010000:3.0:1789123179.174033:0:5826:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789123178 00002000:00010000:3.0:1789123179.174038:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789123178 00010000:00010000:3.0:1789123179.174048:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e74ed8fc/0x7e1648d68fc91e76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f596 expref: 9 pid: 6687 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123179.174070:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e74ed8fc/0x7e1648d68fc91e76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f596 expref: 9 pid: 6687 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123179.174104:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e74ed8fc/0x7e1648d68fc91e76 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f596 expref: 9 pid: 6687 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123179.174130:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789123179.174134:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789123179.174142:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb244ecb/0x7e1648d68fc91ec3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123179.174151:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb244ecb/0x7e1648d68fc91ec3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123179.174189:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789123179.174240:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+8:2355:x1876031364430720:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 278us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123179.174248:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 41 00010000:00010000:0.0:1789123179.174827:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eb244ecb/0x7e1648d68fc91ec3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123179.174856:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb244ecb/0x7e1648d68fc91ec3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123179.174889:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb244ecb/0x7e1648d68fc91ec3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123179.174897:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb244ecb/0x7e1648d68fc91ec3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123179.174906:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb244ecb/0x7e1648d68fc91ec3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123179.174912:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53800 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:0.0:1789123179.174916:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb244ecb/0x7e1648d68fc91ec3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123179.174925:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb244ecb/0x7e1648d68fc91ec3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123179.174938:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb244ecb/0x7e1648d68fc91ec3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123179.174946:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb244ecb/0x7e1648d68fc91ec3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123179.176615:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343fc07840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2355:x1876031364430464:12345-192.168.206.30@tcp:1:lfs.0 Request processed in 123911us (124226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123179.176646:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 23 00000100:00100000:1.0:1789123179.186371:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123179.186491:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364430976 00000100:00100000:0.0:1789123179.186502:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364430976 00000100:00100000:0.0:1789123179.186560:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 8 00000100:00100000:0.0:1789123179.186569:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+20:10517:x1876031364430976:12345-192.168.206.30@tcp:35:lfs.0 00000004:00010000:0.0:1789123179.187253:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91eb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5b2 expref: 20 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789123179.187555:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1789123179.187603:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1789123179.189706:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1789123179.190025:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91eca lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.190051:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc91e5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f588 expref: 24 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.190089:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91eca lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.190151:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc91e5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f588 expref: 24 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.190267:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc91e5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f588 expref: 24 pid: 7640 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123179.190284:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c9b840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5844:1876031381243136:192.168.206.30@tcp:104: 00000100:00100000:1.0:1789123179.190491:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340555ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789123179.207668:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123179.207999:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364431104 00000100:00100000:0.0:1789123179.208008:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364431104 00010000:00010000:0.0:1789123179.208049:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc91e5a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f588 expref: 25 pid: 7640 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123179.208092:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 42 00000100:00100000:0.0:1789123179.208103:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b483c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+25:2354:x1876031364431104:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789123179.208117:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123179.208123:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc91e5a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f588 expref: 25 pid: 7640 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123179.208136:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc91e5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f588 expref: 25 pid: 7640 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123179.208186:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f3411751800) 00010000:00010000:0.0:1789123179.208193:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91eca lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123179.208202:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91eca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123179.208209:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91eca lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123179.208228:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123179.208290:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b483c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+25:2354:x1876031364431104:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 189us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123179.208298:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 42 00010000:00010000:1.0:1789123179.208881:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc91e5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f588 expref: 24 pid: 7640 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123179.208905:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c9b840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5844:1876031381243136:192.168.206.30@tcp:104: 00010000:00010000:1.0:1789123179.208933:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91eca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.208942:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91eca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.208947:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91eca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789123179.209085:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1789123179.209319:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1789123179.209584:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c9b840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1876031381243264:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789123179.209867:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123179.209897:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340555a900 going to sleep for 11 seconds 00000100:00100000:0.0:1789123179.211267:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381243264 00000100:00100000:0.0:1789123179.211277:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381243264 00000100:00100000:0.0:1789123179.211346:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789123179.211355:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409c98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1876031381243264:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789123179.211451:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409c98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1876031381243264:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 97us (1584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123179.211458:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789123179.212066:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789123179.212109:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c9b840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1876031381243264:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789123179.214666:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1789123179.215505:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c9b840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1876031381243392:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789123179.215586:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123179.215665:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340555ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789123179.220621:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381243392 00000100:00100000:0.0:1789123179.220678:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381243392 00000100:00100000:0.0:1789123179.220758:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789123179.220769:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1876031381243392:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789123179.221222:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1876031381243392:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 454us (5635us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789123179.221252:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789123179.221401:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c9b840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1876031381243392:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789123179.221507:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1789123179.221576:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91eca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.221586:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91eca lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.221594:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91eca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.221600:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32a00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123179.221604:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91eca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.221611:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91eca lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.221640:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f3411751800) 00010000:00010000:1.0:1789123179.221643:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789123179.221647:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91eca lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.221659:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91eca lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789123179.221967:0:5844:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789123179.222277:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1789123179.222290:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 293552661414ns, next at 294552659589ns, rc = 0 00000001:00080000:1.0:1789123179.222296:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1789123179.222331:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f3411751800) 00010000:00010000:1.0:1789123179.222335:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789123179.222342:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91eb5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5b2 expref: 28 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123179.222471:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+27:10517:x1876031364430976:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 35902us (36109us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1789123179.222481:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 8 00000020:00080000:1.0:1789123179.222487:0:5844:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789123179.230787:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123179.230923:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364431232 00000100:00100000:1.0:1789123179.230933:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364431232 00000100:00100000:1.0:1789123179.231007:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 45 00000100:00100000:1.0:1789123179.231019:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+27:10517:x1876031364431232:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1789123179.231043:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123179.231083:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc91ed1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f5b9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.231156:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc91ed1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5b9 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.231201:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc91ed1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5b9 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.231239:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f340534d800) 00010000:00010000:1.0:1789123179.231243:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789123179.231248:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd32600, rc 0) 00000100:00100000:1.0:1789123179.231333:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+28:10517:x1876031364431232:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 316us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123179.231341:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 45 00000100:00100000:2.0:1789123179.242238:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123179.242470:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364431488 00000100:00100000:1.0:1789123179.242482:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364431488 00000100:00100000:1.0:1789123179.242550:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00100000:1.0:1789123179.242560:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427abd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+28:10517:x1876031364431488:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:1.0:1789123179.242858:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427abd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+29:10517:x1876031364431488:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 299us (628us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1789123179.242866:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00100000:3.0:1789123179.418746:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123179.418861:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364431744 00000100:00100000:1.0:1789123179.418875:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364431744 00000100:00100000:1.0:1789123179.418944:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 46 00000100:00100000:1.0:1789123179.418956:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343fc061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+29:10527:x1876031364431744:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1789123179.418983:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123179.419007:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91ed8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f5c0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123179.419143:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1789123179.419306:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91ed8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5c0 expref: 31 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.419525:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34232f7f00) 00010000:00010000:1.0:1789123179.419529:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789123179.419536:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91ed8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5c0 expref: 31 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.419552:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd32a00, rc 0) 00000100:00100000:1.0:1789123179.419617:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343fc061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+30:10527:x1876031364431744:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 663us (885us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1789123179.419691:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 46 00000100:00100000:0.0:1789123179.428309:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123179.428502:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364431872 00000100:00100000:1.0:1789123179.428517:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364431872 00000100:00100000:1.0:1789123179.428585:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 47 00000100:00100000:1.0:1789123179.428603:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+30:10527:x1876031364431872:12345-192.168.206.30@tcp:34:lfs.0 00010000:00010000:1.0:1789123179.428753:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91ee6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.428776:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91ee6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.428788:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91ee6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.428820:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc91eed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.428829:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc91eed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.428854:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc91eed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.428983:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91ef4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.428992:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.429000:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789123179.429046:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.429059:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91ee6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.429066:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91ee6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.429081:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91ee6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.429087:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32a00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123179.429092:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91ee6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.429105:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91ee6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.429118:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:1.0:1789123179.429135:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123179.429142:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91ee6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.429149:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91ee6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.429410:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc91eed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.429418:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc91eed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.429436:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc91eed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.429442:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32200 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123179.429446:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc91eed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.429452:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc91eed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.429460:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f340534d500) 00010000:00010000:1.0:1789123179.429469:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123179.429472:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc91eed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.429478:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc91eed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.429492:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.429534:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91ef4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.429539:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.429544:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33c00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123179.429546:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.429552:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91ef4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.429560:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f340534d800) 00010000:00010000:1.0:1789123179.429562:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123179.429564:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91ef4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.429569:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91ef4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123179.429873:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+30:10527:x1876031364431872:12345-192.168.206.30@tcp:34:lfs.0 Request processed in 1211us (1505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123179.429884:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 47 00000100:00100000:2.0:1789123179.442139:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123179.442275:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364432128 00000100:00100000:1.0:1789123179.442286:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364432128 00000100:00100000:1.0:1789123179.442365:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 10 00000100:00100000:1.0:1789123179.442376:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+30:10527:x1876031364432128:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:1.0:1789123179.448710:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+31:10527:x1876031364432128:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 6321us (6569us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1789123179.448757:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 10 00000100:00100000:3.0:1789123179.549612:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123179.549746:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364432384 00000100:00100000:1.0:1789123179.549756:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364432384 00000100:00100000:1.0:1789123179.549826:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 48 00000100:00100000:1.0:1789123179.549837:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343fc04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+31:10530:x1876031364432384:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1789123179.549868:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123179.549896:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91efb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f5c7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.549993:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc91f02 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.550008:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc91f02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.550022:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc91f02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.550036:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91f09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.550044:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91f09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.550051:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91f09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.550189:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc91f10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.550233:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc91f10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.550241:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc91f10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123179.550252:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789123179.550859:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc91f02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.550869:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc91f02 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.550875:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc91f02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.550881:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32200 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123179.550885:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc91f02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.550893:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc91f02 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.550906:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:1.0:1789123179.550909:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123179.550915:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc91f02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.550920:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc91f02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.550934:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91f09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.550950:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91f09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.550955:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91f09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.550961:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32a00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123179.550964:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91f09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.550971:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91f09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.550985:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f340534d500) 00010000:00010000:1.0:1789123179.550988:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123179.550990:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91f09 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.550996:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc91f09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.551046:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91efb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5c7 expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.551060:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc91f10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5c7 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.551068:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f340534d800) 00010000:00010000:1.0:1789123179.551070:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789123179.551079:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd33800, rc 0) 00000100:00100000:1.0:1789123179.551159:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343fc04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+33:10530:x1876031364432384:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 1323us (1555us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1789123179.551168:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 48 00000100:00100000:0.0:1789123179.555888:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123179.555996:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364432512 00000100:00100000:1.0:1789123179.556005:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364432512 00000100:00100000:1.0:1789123179.556066:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 49 00000100:00100000:1.0:1789123179.556076:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+33:10530:x1876031364432512:12345-192.168.206.30@tcp:54:lfs.0 00010000:00010000:1.0:1789123179.556140:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91f1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.556157:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.556177:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.556312:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.556320:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91f1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.556336:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91f1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.556342:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33000 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123179.556345:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91f1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.556353:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91f1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.556384:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f340534d800) 00010000:00010000:1.0:1789123179.556387:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789123179.556393:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91f1e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123179.556399:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91f1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123179.556484:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+33:10530:x1876031364432512:12345-192.168.206.30@tcp:54:lfs.0 Request processed in 407us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123179.556492:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 49 00000100:00100000:2.0:1789123179.569845:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123179.569943:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364432768 00000100:00100000:3.0:1789123179.569955:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364432768 00000100:00100000:3.0:1789123179.570014:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 11 00000100:00100000:3.0:1789123179.570025:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+33:10530:x1876031364432768:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:3.0:1789123179.570333:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+34:10530:x1876031364432768:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 301us (494us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1789123179.570341:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 11 00000100:00100000:3.0:1789123180.016520:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123180.017009:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364433024 00000100:00100000:0.0:1789123180.017019:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364433024 00000100:00100000:0.0:1789123180.017109:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 50 00000100:00100000:0.0:1789123180.017122:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343fc04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+34:10561:x1876031364433024:12345-192.168.206.30@tcp:101:cat.0 00010000:00010000:0.0:1789123180.017150:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123180.017183:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc91f25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f5ce expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123180.017278:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc91f2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123180.017294:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc91f2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123180.017307:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc91f2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123180.017329:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789123180.018014:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc91f25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5ce expref: 37 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123180.018038:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc91f2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5ce expref: 36 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123180.018048:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f340534d800) 00010000:00010000:0.0:1789123180.018067:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789123180.018072:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b52a00, rc 0) 00000100:00100000:0.0:1789123180.018202:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343fc04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+36:10561:x1876031364433024:12345-192.168.206.30@tcp:101:cat.0 Request processed in 1082us (1694us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1789123180.018209:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 50 00000100:00080000:1.0:1789123180.018522:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789123180.037579:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123180.046403:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123180.046663:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364433280 00000100:00100000:3.0:1789123180.046672:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364433280 00000100:00100000:3.0:1789123180.046737:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 12 00000100:00100000:3.0:1789123180.046748:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+36:10561:x1876031364433280:12345-192.168.206.30@tcp:35:cat.0 00000100:00100000:3.0:1789123180.046999:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+37:10561:x1876031364433280:12345-192.168.206.30@tcp:35:cat.0 Request processed in 252us (605us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1789123180.047007:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 12 00000100:00100000:2.0:1789123180.060080:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123180.063558:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364433408 00000100:00100000:3.0:1789123180.063573:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364433408 00000100:00100000:3.0:1789123180.063669:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 3 00000100:00100000:3.0:1789123180.063681:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+37:2354:x1876031364433408:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789123180.063698:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123180.063724:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc91f2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5ce expref: 37 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.063743:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f340534d800) 00010000:00010000:3.0:1789123180.063764:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789123180.063963:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+36:2354:x1876031364433408:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 284us (3894us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123180.063971:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 3 00000100:00100000:3.0:1789123180.156092:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123180.157289:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364433664 00000100:00100000:1.0:1789123180.157303:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364433664 00000100:00100000:1.0:1789123180.157383:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 51 00000100:00100000:1.0:1789123180.157393:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343fc05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+36:10567:x1876031364433664:12345-192.168.206.30@tcp:101:dd.0 00010000:00010000:1.0:1789123180.157417:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123180.157420:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789123180.157459:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc91e92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5a4 expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123180.158148:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:1.0:1789123180.158166:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789123180.158188:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91f3a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f5d5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123180.158296:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91f41 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123180.158341:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc91f10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5c7 expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123180.158351:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91f41 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123180.158386:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc91f10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5c7 expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123180.158402:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc91f10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5c7 expref: 36 pid: 5840 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123180.158417:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d74cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876031381243520:192.168.206.30@tcp:104: 00000100:00100000:1.0:1789123180.158979:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34365bd600 going to sleep for 11 seconds 00000100:00100000:1.0:1789123180.171794:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d74cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876031381243520:192.168.206.30@tcp:104: 00010000:00010000:1.0:1789123180.171830:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91f41 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123180.179203:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123180.179290:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364433792 00000100:00100000:0.0:1789123180.179313:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364433792 00010000:00010000:0.0:1789123180.179396:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc91f10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5c7 expref: 37 pid: 5840 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123180.179468:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 43 00000100:00100000:0.0:1789123180.179514:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343fc043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+37:2354:x1876031364433792:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789123180.179538:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123180.179546:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc91f10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5c7 expref: 37 pid: 5840 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123180.179574:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc91f10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5c7 expref: 37 pid: 5840 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123180.179623:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc91f10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5c7 expref: 37 pid: 5840 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123180.179722:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f340534d800) 00010000:00010000:0.0:1789123180.179736:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91f41 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123180.179745:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91f41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123180.179798:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91f41 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123180.179843:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123180.179951:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343fc043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+36:2354:x1876031364433792:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 453us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123180.179958:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 43 00010000:00010000:1.0:1789123180.180080:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91f41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123180.180100:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91f41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123180.180164:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789123180.180414:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc91f3a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5d5 expref: 37 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123180.180464:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91f41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5d5 expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123180.180486:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f340534d800) 00010000:00010000:1.0:1789123180.180489:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789123180.180503:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd33c00, rc 0) 00000100:00100000:1.0:1789123180.180565:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343fc05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+36:10567:x1876031364433664:12345-192.168.206.30@tcp:101:dd.0 Request processed in 23173us (24485us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1789123180.180585:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 51 00000100:00100000:3.0:1789123180.183693:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123180.183876:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364434048 00000100:00100000:2.0:1789123180.183887:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364434048 00000100:00100000:2.0:1789123180.183948:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 52 00000100:00100000:2.0:1789123180.183958:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343fc05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+36:10567:x1876031364434048:12345-192.168.206.30@tcp:36:dd.0 00010000:00010000:2.0:1789123180.184255:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc91f4f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123180.184273:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc91f4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123180.184285:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc91f4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789123180.184349:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1789123180.184375:0:5840:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000de9b6d64 reply state 0000000014437b12 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc91f4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123180.184384:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789123180.184496:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343fc05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+39:10567:x1876031364434048:12345-192.168.206.30@tcp:36:dd.0 Request processed in 539us (815us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789123180.184504:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 52 00000020:00080000:2.0:1789123180.184510:0:5840:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789123180.188245:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc91f4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123180.188263:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc91f4f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123180.188291:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc91f4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123180.188298:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80aa00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123180.188302:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc91f4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123180.188310:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc91f4f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123180.188326:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f340534d800) 00010000:00010000:2.0:1789123180.188329:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123180.188333:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc91f4f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123180.188339:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc91f4f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123180.432772:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123180.432878:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364434176 00000100:00100000:2.0:1789123180.432889:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364434176 00000100:00100000:2.0:1789123180.432963:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 53 00000100:00100000:2.0:1789123180.432973:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343fc04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+38:10581:x1876031364434176:12345-192.168.206.30@tcp:101:stat.0 00010000:00010000:2.0:1789123180.432998:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123180.433033:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc91f56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f5dc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123180.433113:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc91f5d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123180.433130:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc91f5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123180.433161:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc91f5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123180.433180:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc91f64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123180.433187:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc91f64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123180.433194:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc91f64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123180.433300:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc91f6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123180.433311:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91f41 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5d5 expref: 39 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123180.433320:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc91f6b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123180.433355:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91f41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5d5 expref: 39 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123180.433369:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91f41 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5d5 expref: 39 pid: 5841 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123180.433383:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b48b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876031381243648:192.168.206.30@tcp:104: 00000100:00100000:2.0:1789123180.433488:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410be06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789123180.444284:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b48b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876031381243648:192.168.206.30@tcp:104: 00000100:00100000:3.0:1789123180.444294:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00010000:00010000:2.0:1789123180.444316:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc91f6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123180.445187:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364434432 00000100:00100000:0.0:1789123180.445195:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364434432 00000100:00100000:0.0:1789123180.445285:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 13 00000100:00100000:0.0:1789123180.445296:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343fc06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+40:5590:x1876031364434432:12345-192.168.206.30@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789123180.447803:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343fc06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+41:5590:x1876031364434432:12345-192.168.206.30@tcp:35:ldlm_bl.0 Request processed in 2492us (3517us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1789123180.447822:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 13 00000100:00100000:0.0:1789123180.460173:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123180.460538:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364434560 00000100:00100000:2.0:1789123180.460549:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364434560 00010000:00010000:2.0:1789123180.460600:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91f41 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5d5 expref: 41 pid: 5841 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123180.460670:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 44 00000100:00100000:2.0:1789123180.460684:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3406284c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+41:2355:x1876031364434560:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789123180.460698:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123180.460709:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91f41 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5d5 expref: 41 pid: 5841 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123180.460722:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91f41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5d5 expref: 41 pid: 5841 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123180.460913:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc91f41 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5d5 expref: 41 pid: 5841 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123180.460935:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f340534d800) 00010000:00010000:2.0:1789123180.460944:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc91f6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123180.460955:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc91f6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123180.460963:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc91f6b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123180.461095:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123180.462302:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3406284c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+40:2355:x1876031364434560:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 477us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123180.462315:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 44 00010000:00010000:1.0:1789123180.468920:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc91f6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123180.468944:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc91f6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123180.469005:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789123180.469010:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789123180.469073:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc91f6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123180.469097:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc91f6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123180.469113:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc91f5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123180.469120:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc91f5d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123180.469153:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc91f5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123180.470609:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a200 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123180.470617:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc91f5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123180.470712:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc91f5d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123180.470731:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:1.0:1789123180.470734:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123180.470807:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc91f5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123180.470815:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc91f5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123180.470838:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc91f64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123180.470845:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc91f64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123180.470851:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc91f64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123180.470856:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80b600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123180.470859:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc91f64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123180.470886:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc91f64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123180.470895:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f34232f7100) 00010000:00010000:1.0:1789123180.470897:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123180.470900:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc91f64 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123180.470906:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc91f64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123180.470960:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc91f56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5dc expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123180.470976:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc91f6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5dc expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123180.470983:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f340534d800) 00010000:00010000:1.0:1789123180.470985:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789123180.470987:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80a600, rc 0) 00000100:00100000:1.0:1789123180.471929:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343fc04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+39:10581:x1876031364434176:12345-192.168.206.30@tcp:101:stat.0 Request processed in 38950us (39159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123180.471940:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 53 00000100:00100000:0.0:1789123180.547822:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123180.548476:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364434816 00000100:00100000:3.0:1789123180.548489:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364434816 00000100:00100000:3.0:1789123180.548574:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 54 00000100:00100000:3.0:1789123180.548584:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+39:10587:x1876031364434816:12345-192.168.206.30@tcp:36:truncate.0 00010000:00010000:3.0:1789123180.548685:0:7640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123180.548711:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc91f6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5dc expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.548731:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f340534d800) 00010000:00010000:3.0:1789123180.548736:0:7640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789123180.548947:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3600/0x7e1648d68fc91f72 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.548962:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3600/0x7e1648d68fc91f72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.548971:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3600/0x7e1648d68fc91f72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789123180.549034:0:7640:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1789123180.549080:0:7640:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000cc2c1baa reply state 00000000d6f648f1 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3600/0x7e1648d68fc91f72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123180.549090:0:7640:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789123180.549202:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+41:10587:x1876031364434816:12345-192.168.206.30@tcp:36:truncate.0 Request processed in 620us (1388us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1789123180.549209:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 54 00000020:00080000:3.0:1789123180.549215:0:7640:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789123180.551617:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789123180.551667:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343568d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381243904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789123180.551740:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123180.558593:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789123180.558621:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381243776:0@lo:400:kworker.0 00000100:00100000:0.0:1789123180.558733:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123180.561435:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381243904 00000100:00100000:3.0:1789123180.561455:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381243904 00000100:00100000:3.0:1789123180.561584:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789123180.561595:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381243904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789123180.561660:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789123180.561744:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381243904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (10003us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123180.561753:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1789123180.561924:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789123180.575741:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343568d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381243904:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789123180.575868:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3600/0x7e1648d68fc91f72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123180.575900:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3600/0x7e1648d68fc91f72 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123180.575910:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3600/0x7e1648d68fc91f72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123180.575918:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34029f3600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123180.575923:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3600/0x7e1648d68fc91f72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123180.575931:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3600/0x7e1648d68fc91f72 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123180.575947:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f340534d800) 00010000:00010000:0.0:1789123180.575950:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123180.575955:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3600/0x7e1648d68fc91f72 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123180.575962:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3600/0x7e1648d68fc91f72 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123180.579412:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381243776 00000100:00100000:2.0:1789123180.579436:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381243776 00000100:00100000:2.0:1789123180.579514:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1789123180.579525:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3304:x1876031381243776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123180.579620:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3304:x1876031381243776:12345-0@lo:400:kworker.0 Request processed in 97us (20886us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123180.579647:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1789123180.579708:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381243776:0@lo:400:kworker.0 00000100:00100000:2.0:1789123180.579774:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876031381244032:0@lo:400:kworker.0 00000100:00100000:2.0:1789123180.579812:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123180.579867:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381244032 00000100:00100000:2.0:1789123180.579871:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381244032 00000100:00100000:2.0:1789123180.579908:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789123180.579915:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876031381244032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123180.579951:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876031381244032:12345-0@lo:400:kworker.0 Request processed in 37us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123180.579957:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789123180.579982:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876031381244032:0@lo:400:kworker.0 00000100:00100000:2.0:1789123180.580321:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381244160:0@lo:400:kworker.0 00000100:00100000:2.0:1789123180.580351:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123180.580403:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789123180.580409:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34184c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381244288:0@lo:400:kworker.0 00000100:00100000:2.0:1789123180.580446:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123180.580466:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381244288 00000100:00100000:2.0:1789123180.580469:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381244288 00000100:00100000:3.0:1789123180.580969:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381244160 00000100:00100000:3.0:1789123180.580974:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381244160 00000100:00080000:3.0:1789123180.580994:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789123180.581299:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789123180.581311:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381244160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123180.581353:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381244160:12345-0@lo:400:kworker.0 Request processed in 47us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123180.581360:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789123180.581461:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381244160:0@lo:400:kworker.0 00000100:00100000:2.0:1789123180.590682:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789123180.590708:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407d3f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1876031381244288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123180.591408:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407d3f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1876031381244288:12345-0@lo:400:kworker.0 Request processed in 711us (10958us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123180.591419:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789123180.591487:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343fc070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876031381244416:0@lo:400:kworker.0 00000100:00100000:2.0:1789123180.591594:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123180.591675:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381244416 00000100:00100000:2.0:1789123180.591682:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381244416 00000100:00100000:2.0:1789123180.591730:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789123180.591737:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407d3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876031381244416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123180.591780:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407d3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876031381244416:12345-0@lo:400:kworker.0 Request processed in 43us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123180.591786:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:2.0:1789123180.591803:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789123180.594185:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343fc070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876031381244416:0@lo:400:kworker.0 00000100:00100000:2.0:1789123180.609441:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34184c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381244288:0@lo:400:kworker.0 00000100:00100000:3.0:1789123180.683929:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123180.683982:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364434944 00000100:00100000:3.0:1789123180.683990:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364434944 00000100:00100000:3.0:1789123180.684100:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 55 00000100:00100000:3.0:1789123180.684110:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343fc06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+40:10601:x1876031364434944:12345-192.168.206.30@tcp:101:stat.0 00010000:00010000:3.0:1789123180.684149:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123180.684171:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3600/0x7e1648d68fc91f79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f5e3 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.684696:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91f80 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.684712:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91f80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.684725:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91f80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.684756:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91f87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.684764:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91f87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.684772:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91f87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.685612:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba800/0x7e1648d68fc91f8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.685624:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba800/0x7e1648d68fc91f8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.685646:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba800/0x7e1648d68fc91f8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123180.685691:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1789123180.685695:0:7640:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789123180.685716:0:7640:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba800/0x7e1648d68fc91f8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.685727:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba800/0x7e1648d68fc91f8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.690619:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91f80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.690649:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91f80 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.690657:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91f80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.690663:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34029f2e00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123180.690668:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91f80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.690677:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91f80 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.690695:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:3.0:1789123180.690699:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123180.690703:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91f80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.690709:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f2e00/0x7e1648d68fc91f80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.691085:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91f87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.691093:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91f87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.691099:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91f87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.691104:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34029f3200 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123180.691107:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91f87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.691113:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91f87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.691122:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f3411751500) 00010000:00010000:3.0:1789123180.691125:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123180.691128:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91f87 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.691133:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3200/0x7e1648d68fc91f87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.691196:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f34029f3600/0x7e1648d68fc91f79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5e3 expref: 42 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.691211:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba800/0x7e1648d68fc91f8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5e3 expref: 41 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.691409:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f340534d800) 00010000:00010000:3.0:1789123180.691412:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789123180.691415:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fba800, rc 0) 00000100:00100000:3.0:1789123180.692112:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343fc06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+41:10601:x1876031364434944:12345-192.168.206.30@tcp:101:stat.0 Request processed in 7385us (7591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123180.692122:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 55 00000001:00080000:2.0:1789123180.731591:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967336 is committed 00000004:00080000:2.0:1789123180.731676:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1789123180.731700:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f340555a900 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1789123180.731706:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f341810fc00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f340555a780 00000020:00080000:2.0:1789123180.731733:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f3435914c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f343bfcd000 00000001:00080000:2.0:1789123180.731771:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967338 is committed 00000100:00100000:0.0:1789123180.732101:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789123180.732127:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343568d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381244544:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789123180.732235:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123180.732448:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381244544 00000100:00100000:3.0:1789123180.732457:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381244544 00000100:00100000:3.0:1789123180.732518:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789123180.732529:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1876031381244544:12345-0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1789123180.732538:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00002000:00080000:3.0:1789123180.732570:0:6688:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1789123180.732601:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa3da6a, atime: 0x6aa3da6a, ctime: 0x6aa3da6a, blocks: 0x1 00010000:00010000:3.0:1789123180.732608:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001deccba1/0x7e1648d68fc91f95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.732622:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=295s v=(0 0) 00010000:00010000:3.0:1789123180.732645:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789123180.732653:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001deccba1/0x7e1648d68fc91f95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.732668:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001deccba1/0x7e1648d68fc91f95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.732679:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001deccba1/0x7e1648d68fc91f95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.732697:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001deccba1/0x7e1648d68fc91f95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789123180.732709:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:3.0:1789123180.732712:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789123180.733516:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3302:x1876031381244544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 987us (1284us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789123180.733525:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1789123180.733549:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789123180.733554:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001deccba1/0x7e1648d68fc91f95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.733563:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbba00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:3.0:1789123180.733567:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001deccba1/0x7e1648d68fc91f95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.733577:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001deccba1/0x7e1648d68fc91f95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.733593:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001deccba1/0x7e1648d68fc91f95 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.733601:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001deccba1/0x7e1648d68fc91f95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123180.733619:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123180.733673:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123180.733675:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789123180.735199:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f343568d680/2, rc 0, transno 4294967301 00000100:00100000:2.0:1789123180.735213:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343568d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381244544:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789123180.749338:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123180.749514:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364435200 00000100:00100000:2.0:1789123180.749526:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364435200 00000100:00100000:2.0:1789123180.749619:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 56 00000100:00100000:2.0:1789123180.749683:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+11:10611:x1876031364435200:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1789123180.749712:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123180.749740:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc91f9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f5ea expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123180.750740:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1789123180.750985:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc91f9c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5ea expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123180.751001:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34232f7f00) 00010000:00010000:2.0:1789123180.751005:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789123180.751010:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc91f9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5ea expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123180.751024:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80ae00, rc 0) 00000100:00100000:2.0:1789123180.753544:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+12:10611:x1876031364435200:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 3904us (4209us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1789123180.753557:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 56 00000100:00100000:3.0:1789123180.765996:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123180.771720:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364435456 00000100:00100000:0.0:1789123180.771736:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364435456 00000100:00100000:0.0:1789123180.771799:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 14 00000100:00100000:0.0:1789123180.771810:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343fc052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+12:10611:x1876031364435456:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:2.0:1789123180.781715:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343fc052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+13:10611:x1876031364435456:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 9897us (15720us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1789123180.781739:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 14 00000100:00100000:3.0:1789123181.030147:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123181.031301:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364435712 00000100:00100000:0.0:1789123181.031312:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364435712 00000100:00100000:0.0:1789123181.031377:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 57 00000100:00100000:0.0:1789123181.031387:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343fc07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+13:10617:x1876031364435712:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:0.0:1789123181.031408:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123181.031440:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc91faa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f5f1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123181.031537:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc91fb1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123181.031551:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba800/0x7e1648d68fc91f8e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5e3 expref: 14 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123181.031560:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc91fb1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123181.031595:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba800/0x7e1648d68fc91f8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5e3 expref: 14 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123181.031608:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba800/0x7e1648d68fc91f8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5e3 expref: 14 pid: 7640 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123181.031621:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343568c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876031381244672:192.168.206.30@tcp:104: 00000100:00100000:0.0:1789123181.031740:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f342d7346c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123181.044333:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123181.050264:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364435840 00000100:00100000:2.0:1789123181.050277:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364435840 00010000:00010000:2.0:1789123181.050342:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba800/0x7e1648d68fc91f8e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5e3 expref: 15 pid: 7640 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123181.050387:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 45 00000100:00100000:2.0:1789123181.050397:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+15:2355:x1876031364435840:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789123181.050412:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123181.050428:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba800/0x7e1648d68fc91f8e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5e3 expref: 15 pid: 7640 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.050441:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba800/0x7e1648d68fc91f8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5e3 expref: 15 pid: 7640 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.050463:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f340534d800) 00010000:00010000:2.0:1789123181.050468:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc91fb1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.050478:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc91fb1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.050485:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc91fb1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.050517:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123181.050583:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+15:2355:x1876031364435840:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 187us (6259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123181.050612:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 45 00010000:00010000:0.0:1789123181.059912:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba800/0x7e1648d68fc91f8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5e3 expref: 14 pid: 7640 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123181.059966:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343568c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876031381244672:192.168.206.30@tcp:104: 00010000:00010000:0.0:1789123181.059991:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc91fb1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123181.060001:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc91fb1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123181.060007:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc91fb1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123181.060028:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1789123181.060183:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc91faa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5f1 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123181.060199:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc91fb1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5f1 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123181.060208:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f340534d800) 00010000:00010000:0.0:1789123181.060211:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789123181.060215:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53c00, rc 0) 00000100:00100000:0.0:1789123181.060272:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343fc07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+14:10617:x1876031364435712:12345-192.168.206.30@tcp:101:bash.0 Request processed in 28886us (30133us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1789123181.060280:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 57 00010000:00010000:3.0:1789123181.062092:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123181.066358:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123181.066611:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364436096 00000100:00100000:3.0:1789123181.066621:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364436096 00000100:00100000:3.0:1789123181.066714:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 58 00000100:00100000:3.0:1789123181.066724:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+14:10617:x1876031364436096:12345-192.168.206.30@tcp:36:bash.0 00010000:00010000:3.0:1789123181.066987:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc91fbf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.067003:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc91fbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.067015:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc91fbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789123181.067065:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1789123181.067088:0:5840:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000056eb9f2d reply state 00000000a119fff5 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc91fbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123181.067096:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789123181.068065:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+17:10617:x1876031364436096:12345-192.168.206.30@tcp:36:bash.0 Request processed in 1336us (1709us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1789123181.068074:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 58 00000020:00080000:3.0:1789123181.068081:0:5840:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789123181.080397:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc91fbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.080414:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc91fbf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.080433:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc91fbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.080440:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbba00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123181.080446:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc91fbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.080455:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc91fbf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.080472:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f340534d800) 00010000:00010000:2.0:1789123181.080476:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123181.080481:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc91fbf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.080488:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc91fbf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123181.098440:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123181.098676:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364436224 00000100:00100000:3.0:1789123181.098686:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364436224 00000100:00100000:3.0:1789123181.098763:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 59 00000100:00100000:3.0:1789123181.098775:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+16:10617:x1876031364436224:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:3.0:1789123181.098818:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123181.098838:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc91fc6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f5f8 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.098925:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbe00/0x7e1648d68fc91fcd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.098942:0:7640:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc91fb1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5f1 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.098951:0:7640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbe00/0x7e1648d68fc91fcd lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.098982:0:7640:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc91fb1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5f1 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.098995:0:7640:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc91fb1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5f1 expref: 17 pid: 5842 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123181.099006:0:7640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343fc05a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1876031381244800:192.168.206.30@tcp:104: 00000100:00100000:3.0:1789123181.100871:0:7640:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340e0663c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123181.108079:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123181.108264:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364436352 00000100:00100000:2.0:1789123181.108273:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364436352 00010000:00010000:2.0:1789123181.108326:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc91fb1 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5f1 expref: 18 pid: 5842 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123181.108368:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 46 00000100:00100000:2.0:1789123181.108393:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+18:2355:x1876031364436352:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789123181.108408:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123181.108416:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc91fb1 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5f1 expref: 18 pid: 5842 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.108441:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc91fb1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5f1 expref: 18 pid: 5842 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.108464:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f340534d800) 00010000:00010000:2.0:1789123181.108470:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbe00/0x7e1648d68fc91fcd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.108479:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbe00/0x7e1648d68fc91fcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.108487:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbe00/0x7e1648d68fc91fcd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.108507:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123181.108564:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+18:2355:x1876031364436352:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 172us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123181.108572:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 46 00010000:00010000:3.0:1789123181.111826:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc91fb1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5f1 expref: 17 pid: 5842 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123181.111852:0:7640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343fc05a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1876031381244800:192.168.206.30@tcp:104: 00010000:00010000:3.0:1789123181.111873:0:7640:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbe00/0x7e1648d68fc91fcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.111909:0:7640:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbe00/0x7e1648d68fc91fcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.111916:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbe00/0x7e1648d68fc91fcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123181.111960:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789123181.111964:0:7640:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789123181.111985:0:7640:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbe00/0x7e1648d68fc91fcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.112018:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc91fc6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5f8 expref: 17 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.112141:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbe00/0x7e1648d68fc91fcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5f8 expref: 16 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.112151:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f340534d800) 00010000:00010000:3.0:1789123181.112154:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789123181.112157:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbbe00, rc 0) 00000100:00100000:3.0:1789123181.112226:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+16:10617:x1876031364436224:12345-192.168.206.30@tcp:101:bash.0 Request processed in 13453us (13805us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123181.112235:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 59 00000100:00100000:1.0:1789123181.134151:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123181.134475:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364436608 00000100:00100000:2.0:1789123181.134484:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364436608 00000100:00100000:2.0:1789123181.134540:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 15 00000100:00100000:2.0:1789123181.134549:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427abc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+16:10617:x1876031364436608:12345-192.168.206.30@tcp:35:bash.0 00000100:00100000:2.0:1789123181.134804:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427abc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+17:10617:x1876031364436608:12345-192.168.206.30@tcp:35:bash.0 Request processed in 254us (660us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1789123181.134831:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 15 00000100:00100000:1.0:1789123181.414572:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123181.415431:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364436864 00000100:00100000:2.0:1789123181.415442:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364436864 00000100:00100000:2.0:1789123181.415511:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 60 00000100:00100000:2.0:1789123181.415522:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+17:10627:x1876031364436864:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1789123181.415555:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123181.415575:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc91fd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f5ff expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123181.415861:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1789123181.416033:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc91fd4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5ff expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.416048:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34232f7f00) 00010000:00010000:2.0:1789123181.416051:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789123181.416055:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc91fd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5ff expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.416068:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80ae00, rc 0) 00000100:00100000:2.0:1789123181.417809:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+18:10627:x1876031364436864:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 1793us (2750us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1789123181.417822:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 60 00000100:00100000:0.0:1789123181.433953:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123181.435862:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364436992 00000100:00100000:2.0:1789123181.435876:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364436992 00000100:00100000:2.0:1789123181.435953:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 61 00000100:00100000:2.0:1789123181.435964:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+18:10627:x1876031364436992:12345-192.168.206.30@tcp:34:lfs.0 00010000:00010000:2.0:1789123181.436081:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc91fe2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.436099:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc91fe2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.436111:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc91fe2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.436126:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc91fe9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.436133:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc91fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.436139:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc91fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.436987:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91ff0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.436999:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.439993:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789123181.450040:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.450070:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc91fe2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.450105:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc91fe2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.450114:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc91fe2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.450121:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80ae00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123181.450125:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc91fe2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.450133:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc91fe2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.450150:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:3.0:1789123181.450154:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123181.450159:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc91fe2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.450165:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc91fe2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.450184:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc91fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.450190:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc91fe9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.450196:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc91fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.450201:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80bc00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123181.450210:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc91fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.450217:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc91fe9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.450225:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f34232f7500) 00010000:00010000:3.0:1789123181.450228:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123181.450231:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc91fe9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.450236:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc91fe9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.450254:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.450259:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91ff0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.450265:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91ff0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.450269:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123181.450272:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91ff0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.450277:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91ff0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.450284:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f340534d800) 00010000:00010000:3.0:1789123181.450285:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123181.450294:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91ff0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.450300:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc91ff0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123181.453801:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+18:10627:x1876031364436992:12345-192.168.206.30@tcp:34:lfs.0 Request processed in 17826us (19847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123181.453936:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 61 00000100:00100000:1.0:1789123181.458036:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123181.458559:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364437248 00000100:00100000:2.0:1789123181.458570:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364437248 00000100:00100000:2.0:1789123181.458651:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 16 00000100:00100000:2.0:1789123181.458661:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+18:10627:x1876031364437248:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:2.0:1789123181.461479:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+19:10627:x1876031364437248:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 2808us (3440us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1789123181.461515:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 16 00000100:00100000:1.0:1789123181.601672:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123181.603803:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364437504 00000100:00100000:3.0:1789123181.603817:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364437504 00000100:00100000:3.0:1789123181.603894:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 62 00000100:00100000:3.0:1789123181.603905:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+19:10630:x1876031364437504:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:3.0:1789123181.603932:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123181.603953:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc91ff7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f606 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.604021:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc91ffe lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.604036:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc91ffe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.604047:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc91ffe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.604062:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbaa00/0x7e1648d68fc92005 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.604070:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbaa00/0x7e1648d68fc92005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.604099:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbaa00/0x7e1648d68fc92005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.604474:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc9200c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.604483:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc9200c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.604491:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc9200c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123181.604501:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789123181.604593:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc91ffe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.604601:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc91ffe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.604608:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc91ffe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.604613:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbb200 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123181.604617:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc91ffe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.604624:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc91ffe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.604675:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:3.0:1789123181.604678:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123181.604689:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc91ffe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.604695:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc91ffe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.604707:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbaa00/0x7e1648d68fc92005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.604713:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbaa00/0x7e1648d68fc92005 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.604718:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbaa00/0x7e1648d68fc92005 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.604722:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbaa00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123181.604725:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbaa00/0x7e1648d68fc92005 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.604731:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbaa00/0x7e1648d68fc92005 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.604738:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f3411751b00) 00010000:00010000:3.0:1789123181.604740:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123181.604743:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbaa00/0x7e1648d68fc92005 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.604749:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbaa00/0x7e1648d68fc92005 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.604788:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc91ff7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f606 expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.604813:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc9200c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f606 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.604820:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f340534d800) 00010000:00010000:3.0:1789123181.604823:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789123181.604826:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fba600, rc 0) 00000100:00100000:3.0:1789123181.604890:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+21:10630:x1876031364437504:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 987us (3226us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1789123181.604899:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 62 00000100:00100000:0.0:1789123181.616390:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123181.616458:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123181.616567:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364437760 00000100:00100000:2.0:1789123181.616576:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364437760 00000100:00100000:2.0:1789123181.616677:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 4 00000100:00100000:2.0:1789123181.616689:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+21:2353:x1876031364437760:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789123181.616705:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123181.616740:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc9200c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f606 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.616761:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f340534d800) 00010000:00010000:2.0:1789123181.616766:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123181.616821:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+20:2353:x1876031364437760:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 134us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123181.616828:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 4 00000100:00100000:3.0:1789123181.617937:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364437632 00000100:00100000:3.0:1789123181.617946:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364437632 00000100:00100000:3.0:1789123181.617996:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 63 00000100:00100000:3.0:1789123181.618006:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+20:10630:x1876031364437632:12345-192.168.206.30@tcp:54:lfs.0 00010000:00010000:3.0:1789123181.618066:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc9201a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.618082:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc9201a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.618093:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc9201a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.618118:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc9201a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.618125:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc9201a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.618154:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc9201a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.618160:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fba000 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123181.618163:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc9201a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.618171:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc9201a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.618181:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f340534d800) 00010000:00010000:3.0:1789123181.618184:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789123181.618188:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc9201a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.618194:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc9201a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123181.618245:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+20:10630:x1876031364437632:12345-192.168.206.30@tcp:54:lfs.0 Request processed in 240us (1785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123181.618252:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 63 00000100:00100000:1.0:1789123181.627140:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123181.627230:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364438016 00000100:00100000:2.0:1789123181.627240:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364438016 00000100:00100000:2.0:1789123181.627297:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 17 00000100:00100000:2.0:1789123181.627308:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+20:10630:x1876031364438016:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:2.0:1789123181.627570:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+21:10630:x1876031364438016:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 264us (440us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1789123181.627579:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 17 00000100:00100000:0.0:1789123181.901060:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123181.901169:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364438272 00000100:00100000:3.0:1789123181.901179:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364438272 00000100:00100000:3.0:1789123181.901242:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 64 00000100:00100000:3.0:1789123181.901253:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+21:10648:x1876031364438272:12345-192.168.206.30@tcp:101:cat.0 00010000:00010000:3.0:1789123181.901278:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123181.901316:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc92021 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f60d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.901619:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbaa00/0x7e1648d68fc92028 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.901682:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbaa00/0x7e1648d68fc92028 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.901697:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbaa00/0x7e1648d68fc92028 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123181.901709:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789123181.901849:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc92021 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f60d expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.901868:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbaa00/0x7e1648d68fc92028 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f60d expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.901877:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f340534d800) 00010000:00010000:3.0:1789123181.901880:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789123181.901884:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbaa00, rc 0) 00000100:00100000:3.0:1789123181.901947:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+23:10648:x1876031364438272:12345-192.168.206.30@tcp:101:cat.0 Request processed in 696us (897us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1789123181.901954:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 64 00000100:00100000:0.0:1789123181.929195:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123181.930856:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364438400 00000100:00100000:3.0:1789123181.930868:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364438400 00000100:00100000:3.0:1789123181.930935:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 65 00000100:00100000:3.0:1789123181.930946:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+23:10649:x1876031364438400:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:3.0:1789123181.930970:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123181.931014:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc92036 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f614 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.931098:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc9203d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.931112:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc9203d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.931123:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc9203d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123181.931298:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1789123181.931302:0:7640:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789123181.931391:0:7640:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc9203d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.932808:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc92036 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f614 expref: 25 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.932831:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc9203d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f614 expref: 24 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.932839:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:3.0:1789123181.932842:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789123181.932846:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbb200, rc 0) 00000100:00100000:3.0:1789123181.932914:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+24:10649:x1876031364438400:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 1969us (3726us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123181.932922:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 65 00000100:00100000:3.0:1789123181.940850:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123181.941035:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364438784 00000100:00100000:2.0:1789123181.941048:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364438784 00000100:00100000:2.0:1789123181.941281:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 18 00000100:00100000:2.0:1789123181.941298:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343fc05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+24:10649:x1876031364438784:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:2.0:1789123181.941768:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343fc05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+25:10649:x1876031364438784:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 473us (931us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1789123181.950689:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 18 00000100:00100000:1.0:1789123181.951175:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123181.951251:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364438912 00000100:00100000:2.0:1789123181.951262:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364438912 00000100:00100000:2.0:1789123181.951338:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 5 00000100:00100000:2.0:1789123181.951349:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+25:10649:x1876031364438912:12345-192.168.206.30@tcp:103:lfs.0 00010000:00010000:2.0:1789123181.951367:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789123181.951398:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbe00/0x7e1648d68fc91fcd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5f8 expref: 25 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.951432:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbaa00/0x7e1648d68fc92028 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f60d expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.951447:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc91ed1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f5b9 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123181.951457:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f340534d800) 00010000:00010000:2.0:1789123181.951470:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123181.951551:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+22:10649:x1876031364438912:12345-192.168.206.30@tcp:103:lfs.0 Request processed in 203us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123181.951559:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 5 00000100:00100000:1.0:1789123181.954449:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123181.954575:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364439040 00000100:00100000:3.0:1789123181.954589:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364439040 00000100:00100000:3.0:1789123181.954685:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 66 00000100:00100000:3.0:1789123181.954697:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+22:10649:x1876031364439040:12345-192.168.206.30@tcp:58:lfs.0 00010000:00010000:3.0:1789123181.954836:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc92044 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.954854:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc92044 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123181.954866:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc92044 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789123181.955590:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789123181.955849:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1789123181.955927:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1789123181.956049:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+22:10649:x1876031364439040:12345-192.168.206.30@tcp:58:lfs.0 Request processed in 1351us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123181.956059:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 66 00000100:00100000:2.0:1789123181.984238:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123181.984581:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364439168 00000100:00100000:1.0:1789123181.984593:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364439168 00000100:00100000:1.0:1789123181.984700:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 67 00000100:00100000:1.0:1789123181.984712:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+22:10651:x1876031364439168:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1789123181.984747:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123181.984775:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9204b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f61b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123181.984861:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc92052 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123181.984879:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc92052 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123181.984892:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc92052 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123181.984908:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92059 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123181.984915:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92059 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123181.984937:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92059 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123181.985504:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc92060 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123181.985516:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc92060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123181.985525:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc92060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123181.985568:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789123181.985573:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789123181.985596:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc92060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123181.985610:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc92060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123181.985619:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc92052 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123181.985654:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc92052 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123181.985662:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc92052 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123181.985669:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123181.985673:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc92052 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123181.985690:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc92052 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123181.985704:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:1.0:1789123181.985708:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123181.985714:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc92052 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123181.985720:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc92052 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123181.986232:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92059 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123181.986239:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92059 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123181.986246:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92059 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123181.986252:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32c00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123181.986256:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92059 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123181.986263:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92059 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123181.986555:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f340534d500) 00010000:00010000:1.0:1789123181.986559:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123181.986564:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92059 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123181.986585:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92059 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123181.986761:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9204b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f61b expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123181.986781:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc92060 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f61b expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123181.986789:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f3411751b00) 00010000:00010000:1.0:1789123181.986792:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789123181.986794:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd33400, rc 0) 00000100:00100000:1.0:1789123181.986883:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+23:10651:x1876031364439168:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 2172us (2656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123181.986893:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 67 00010000:00010000:1.0:1789123182.085148:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123182.085280:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34049a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381244928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789123182.085391:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123182.085592:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381244928 00000100:00100000:0.0:1789123182.085602:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381244928 00000100:00100000:0.0:1789123182.085706:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789123182.085718:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1876031381244928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789123182.085764:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789123182.085818:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1876031381244928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123182.085826:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1789123182.085983:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789123182.086039:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34049a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381244928:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789123182.148930:0:12081:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789123182.148941:0:12081:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789123182.148989:0:12081:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789123182.148996:0:12081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789123182.149158:0:12081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062db0c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12081:1876031381245056:192.168.206.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789123182.149276:0:12081:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408e59b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789123182.155058:0:12081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062db0c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12081:1876031381245056:192.168.206.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789123182.159825:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123182.159942:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364439296 00000100:00100000:1.0:1789123182.159951:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364439296 00000100:00100000:1.0:1789123182.160020:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 1 00000100:00100000:1.0:1789123182.160031:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:64de9449-4320-4c9f-abcb-230edd2b11ae+23:10662:x1876031364439296:12345-192.168.206.30@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789123182.160102:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:64de9449-4320-4c9f-abcb-230edd2b11ae+23:10662:x1876031364439296:12345-192.168.206.30@tcp:900:lhsmtool_posix.0 Request processed in 73us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123182.160109:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 1 00000100:00080000:2.0:1789123182.160477:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789123182.162804:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123182.162912:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364439424 00000100:00100000:0.0:1789123182.162920:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364439424 00000100:00100000:0.0:1789123182.162976:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 68 00000100:00100000:0.0:1789123182.162986:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343fc06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+23:10662:x1876031364439424:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789123182.163015:0:5840:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789123182.172229:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343fc06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+23:10662:x1876031364439424:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 Request processed in 9232us (9420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123182.172244:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 68 00000100:00100000:2.0:1789123182.181621:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123182.181752:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364439552 00000100:00100000:3.0:1789123182.181768:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364439552 00000100:00100000:0.0:1789123182.181893:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 69 00000100:00100000:0.0:1789123182.182027:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+23:10662:x1876031364439552:12345-192.168.206.30@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789123182.182114:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc92067 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.182131:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc92067 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.182143:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc92067 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.182753:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc9206e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.182770:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc9206e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.182777:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc9206e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.182805:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92075 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.182813:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.182820:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123182.182855:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789123182.182860:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789123182.182873:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.182884:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc92067 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.182890:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc92067 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.182897:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc92067 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.182904:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123182.182908:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc92067 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.182921:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc92067 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.182933:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f3411751e00) 00010000:00010000:0.0:1789123182.182936:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123182.182940:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc92067 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.182946:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc92067 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.185040:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc9206e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.185051:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc9206e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.185057:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc9206e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.185064:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53e00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123182.185068:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc9206e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.185090:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc9206e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.185104:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9f34226c1800) 00010000:00010000:0.0:1789123182.185107:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123182.185111:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc9206e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.185129:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc9206e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.185148:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.185154:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92075 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.185160:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92075 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.185165:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52800 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123182.185168:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92075 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.185174:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92075 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.185183:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f3411751b00) 00010000:00010000:0.0:1789123182.185185:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123182.185188:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92075 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.185194:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92075 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123182.185290:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+23:10662:x1876031364439552:12345-192.168.206.30@tcp:34:lhsmtool_posix.0 Request processed in 3381us (3673us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123182.190476:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123182.191252:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364439808 00000100:00100000:3.0:1789123182.191269:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364439808 00000100:00100000:3.0:1789123182.191343:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 70 00000100:00100000:3.0:1789123182.191355:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+24:10662:x1876031364439808:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789123182.191381:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123182.191408:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc9207c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f622 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.191558:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc92083 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.191576:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc92083 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.191590:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc92083 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123182.191603:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000100:00100000:0.0:1789123182.192157:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 69 00010000:00010000:1.0:1789123182.193063:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc92083 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123182.193077:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc92083 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123182.193085:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc92083 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123182.193092:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fba200 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123182.193096:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc92083 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123182.193103:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc92083 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123182.193117:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f3411751b00) 00010000:00010000:1.0:1789123182.193120:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789123182.193125:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc92083 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123182.193131:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc92083 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123182.193187:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc9207c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f622 expref: 25 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123182.193198:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f3411751e00) 00010000:00010000:1.0:1789123182.193201:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789123182.193204:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc9207c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f622 expref: 25 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123182.193227:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbb000, rc 0) 00000100:00100000:1.0:1789123182.194064:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+24:10662:x1876031364439808:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 2708us (3594us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1789123182.194074:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 70 00000100:00100000:2.0:1789123182.200469:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123182.201491:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364439936 00000100:00100000:3.0:1789123182.201508:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364439936 00000100:00100000:3.0:1789123182.201597:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 71 00000100:00100000:3.0:1789123182.201611:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+24:10662:x1876031364439936:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789123182.201692:0:7640:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789123182.201850:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+24:10662:x1876031364439936:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 Request processed in 242us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123182.201859:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 71 00000100:00100000:2.0:1789123182.205839:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123182.205916:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364440192 00000100:00100000:1.0:1789123182.205929:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364440192 00000100:00100000:1.0:1789123182.206005:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 72 00000100:00100000:1.0:1789123182.206016:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+24:10662:x1876031364440192:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789123182.206035:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123182.206038:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789123182.206061:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc9203d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f614 expref: 24 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123182.206077:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:1.0:1789123182.206082:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789123182.206094:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc92091 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f629 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789123182.206736:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1789123182.206961:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc92098 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123182.206975:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc92098 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123182.206984:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc92098 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123182.207043:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc92091 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f629 expref: 26 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123182.207057:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc92098 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f629 expref: 25 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123182.207065:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f340534d500) 00010000:00010000:1.0:1789123182.207067:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789123182.207070:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd33200, rc 0) 00000100:00100000:1.0:1789123182.207133:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+25:10662:x1876031364440192:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 1119us (1309us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1789123182.207141:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 72 00000100:00100000:2.0:1789123182.214131:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123182.214233:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364440448 00000100:00100000:3.0:1789123182.214251:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364440448 00000100:00100000:2.0:1789123182.215161:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 73 00000100:00100000:2.0:1789123182.215176:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+25:10662:x1876031364440448:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789123182.215228:0:7640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123182.215253:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc92098 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f629 expref: 25 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.215269:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f340534d500) 00010000:00010000:2.0:1789123182.215279:0:7640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789123182.215310:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc920a6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.215323:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc920a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.215333:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc920a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.215428:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc920ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x9b48c9b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.215438:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc920ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9b48c9b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.215447:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc920ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9b48c9b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.215747:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc920a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.215756:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc920a6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.215763:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc920a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.215769:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80b400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123182.215773:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc920a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.215781:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc920a6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.215792:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:2.0:1789123182.215795:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123182.215800:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc920a6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.215806:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc920a6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.215821:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc920ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9b48c9b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.215826:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc920ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9b48c9b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.215832:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc920ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9b48c9b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.215836:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80aa00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123182.215839:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc920ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9b48c9b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.215844:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc920ad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9b48c9b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.215851:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x9b48c9b8 (ffff9f34232f7800) 00010000:00010000:2.0:1789123182.215854:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123182.215857:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc920ad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9b48c9b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.215862:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc920ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9b48c9b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123182.215947:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+24:10662:x1876031364440448:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 775us (1825us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789123182.216556:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 73 00000100:00100000:2.0:1789123182.219471:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123182.219848:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364440576 00000100:00100000:3.0:1789123182.219858:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364440576 00000100:00100000:3.0:1789123182.219917:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 74 00000100:00100000:3.0:1789123182.219926:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+24:10662:x1876031364440576:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789123182.219944:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123182.219973:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc920b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f630 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.220021:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc920bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.220034:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc920bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.220045:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc920bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.220140:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc920b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f630 expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.220156:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc920bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f630 expref: 25 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.220164:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f3411751500) 00010000:00010000:3.0:1789123182.220167:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789123182.220170:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fba400, rc 0) 00000100:00100000:3.0:1789123182.220225:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+25:10662:x1876031364440576:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 300us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123182.220232:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 74 00000100:00100000:0.0:1789123182.235093:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123182.235175:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364440832 00000100:00100000:2.0:1789123182.235183:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364440832 00000100:00100000:2.0:1789123182.235252:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 75 00000100:00100000:2.0:1789123182.235261:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+25:10662:x1876031364440832:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789123182.235342:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc920c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.235358:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc920c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.235369:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc920c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789123182.235768:0:7640:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1789123182.235779:0:7640:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 296566151098ns, next at 297566148486ns, rc = 0 00000004:00010000:2.0:1789123182.235857:0:7640:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008835b8c4 reply state 000000007acc6ed2 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc920c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123182.235866:0:7640:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789123182.237083:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+27:10662:x1876031364440832:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 690us (865us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1789123182.237093:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 75 00010000:00010000:0.0:1789123182.237571:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc920c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.237582:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc920c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.237589:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc920c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.237594:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80aa00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123182.237599:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc920c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.237606:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc920c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.237620:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f3411751500) 00010000:00010000:0.0:1789123182.237624:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789123182.237654:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc920c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.237661:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc920c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123182.243943:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123182.245087:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364440960 00000100:00100000:1.0:1789123182.245101:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364440960 00000100:00100000:1.0:1789123182.245180:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 76 00000100:00100000:1.0:1789123182.245192:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343fc052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+26:10662:x1876031364440960:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789123182.245214:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123182.245234:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc920c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f637 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123182.245290:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc920c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f637 expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123182.245318:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc920c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f637 expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123182.245353:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f3411751500) 00010000:00010000:1.0:1789123182.245357:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789123182.245361:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd32600, rc 0) 00000100:00100000:1.0:1789123182.245449:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343fc052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+27:10662:x1876031364440960:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 259us (1520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123182.245456:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 76 00000100:00100000:3.0:1789123182.252438:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123182.252742:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364441088 00000100:00100000:0.0:1789123182.252756:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364441088 00000100:00100000:0.0:1789123182.256693:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 25 00000100:00100000:0.0:1789123182.256705:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343fc070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1876031364441088:12345-192.168.206.30@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1789123182.256741:0:8519:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 64de9449-4320-4c9f-abcb-230edd2b11ae@192.168.206.30@tcp t0 exp 0000000000000000 cur 296 last 0 00000020:00000080:0.0:1789123182.256771:0:8519:0:(genops.c:1385:class_connect()) connect: client 64de9449-4320-4c9f-abcb-230edd2b11ae, cookie 0x7e1648d68fc920d0 00002000:00100000:0.0:1789123182.256791:0:8519:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 64de9449-4320-4c9f-abcb-230edd2b11ae/ffff9f343fca1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398a ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789123182.256815:0:8519:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789123182.257068:0:8519:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789123182.257101:0:8519:0:(import.c:65:import_set_state_nolock()) ffff9f343fca7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789123182.257169:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343fc070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2351:x1876031364441088:12345-192.168.206.30@tcp:8:lhsmtool_posix.0 Request processed in 463us (4757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123182.257176:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 25 00000100:00100000:3.0:1789123182.261695:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123182.278776:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364441216 00000100:00100000:1.0:1789123182.278790:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364441216 00000100:00100000:1.0:1789123182.278901:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 26 00000100:00100000:1.0:1789123182.278914:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343fc043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+6:0:x1876031364441216:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789123182.278948:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1789123182.407068:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 64de9449-4320-4c9f-abcb-230edd2b11ae 00000100:00100000:1.0:1789123182.407325:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343fc043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+6:0:x1876031364441216:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 Request processed in 128397us (145627us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789123182.407343:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 26 00000001:00080000:0.0:1789123182.407409:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1789123182.413035:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123182.413129:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364441472 00000100:00100000:2.0:1789123182.413148:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364441472 00000100:00100000:2.0:1789123182.413250:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 19 00000100:00100000:2.0:1789123182.413264:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+27:10662:x1876031364441472:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789123182.413711:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+28:10662:x1876031364441472:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 Request processed in 449us (692us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1789123182.413720:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 19 00000100:00100000:2.0:1789123182.417874:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123182.421845:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364441728 00000100:00100000:1.0:1789123182.421868:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364441728 00000100:00100000:0.0:1789123182.422082:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 77 00000100:00100000:0.0:1789123182.422109:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+28:10662:x1876031364441728:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789123182.422228:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+28:10662:x1876031364441728:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 123us (4371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123182.430283:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123182.430371:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364441856 00000100:00100000:3.0:1789123182.430396:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364441856 00000100:00100000:3.0:1789123182.430478:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 78 00000100:00100000:3.0:1789123182.430489:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+29:10662:x1876031364441856:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789123182.430515:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123182.430540:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc920d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f63e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.430828:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc920de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.430846:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc920de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.430859:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc920de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123182.430906:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789123182.430933:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc920de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.430962:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc920d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f63e expref: 31 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.430981:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc920de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f63e expref: 30 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.430990:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f3411751500) 00010000:00010000:3.0:1789123182.430993:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789123182.430998:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbb800, rc 0) 00000100:00100000:3.0:1789123182.431073:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+30:10662:x1876031364441856:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 585us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123182.431088:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 78 00000100:00100000:0.0:1789123182.431513:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 77 00000100:00100000:0.0:1789123182.437380:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123182.437504:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364441984 00000100:00100000:1.0:1789123182.437513:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364441984 00000100:00100000:1.0:1789123182.437571:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 27 00000100:00100000:1.0:1789123182.437580:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2355:x1876031364441984:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789123182.437596:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123182.437618:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8b80ee9/0x7e1648d68fc920e5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f645 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789123182.437685:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3da6d, blocks: 0x1 00010000:00010000:1.0:1789123182.437705:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=296s v=(0 0) 00010000:00010000:1.0:1789123182.437725:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123182.437735:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8b80ee9/0x7e1648d68fc920e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f645 expref: 6 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123182.437756:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d8b80ee9/0x7e1648d68fc920e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f645 expref: 6 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123182.437769:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd32a00, rc 0) 00000100:00100000:1.0:1789123182.437825:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2355:x1876031364441984:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 246us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123182.437833:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 27 00000100:00100000:2.0:1789123182.443269:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123182.444066:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364442240 00000100:00100000:1.0:1789123182.444080:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364442240 00000100:00100000:1.0:1789123182.444145:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 79 00000100:00100000:1.0:1789123182.444156:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+29:10662:x1876031364442240:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789123182.444265:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+29:10662:x1876031364442240:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 111us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123182.444273:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 79 00000100:00100000:1.0:1789123182.463157:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123182.463239:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364442368 00000100:00100000:0.0:1789123182.463248:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364442368 00000100:00100000:0.0:1789123182.463310:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 28 00000100:00100000:0.0:1789123182.463320:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+6:10662:x1876031364442368:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789123182.463337:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123182.463357:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc920ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f64c expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.463388:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8b80ee9/0x7e1648d68fc920e5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f645 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.463428:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123182.463433:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123182.463440:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc920ec lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f64c expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.463474:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d8b80ee9/0x7e1648d68fc920e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f645 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.463488:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d8b80ee9/0x7e1648d68fc920e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f645 expref: 7 pid: 6687 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123182.463501:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1876031381245184:192.168.206.30@tcp:104: 00000100:00100000:0.0:1789123182.463596:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f342d734840 going to sleep for 11 seconds 00000100:00100000:0.0:1789123182.477766:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1876031381245184:192.168.206.30@tcp:104: 00010000:00010000:0.0:1789123182.477811:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc920ec lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f64c expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.477831:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b52800, rc 0) 00000100:00100000:0.0:1789123182.477899:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+7:10662:x1876031364442368:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 14580us (14750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123182.477908:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 28 00000100:00100000:2.0:1789123182.480182:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123182.481067:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364442496 00000100:00100000:0.0:1789123182.481080:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364442496 00010000:00010000:0.0:1789123182.481128:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d8b80ee9/0x7e1648d68fc920e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f645 expref: 7 pid: 6687 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123182.481195:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 47 00000100:00100000:0.0:1789123182.481204:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2355:x1876031364442496:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789123182.481220:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123182.481240:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d8b80ee9/0x7e1648d68fc920e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f645 expref: 7 pid: 6687 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.481254:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d8b80ee9/0x7e1648d68fc920e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f645 expref: 7 pid: 6687 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.481278:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8b80ee9/0x7e1648d68fc920e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f645 expref: 7 pid: 6687 timeout: 396 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.481295:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123182.481299:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123182.481308:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc920ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f64c expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.481317:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc920ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f64c expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.481352:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc920ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f64c expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123182.481365:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d54000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876031381245312:192.168.206.30@tcp:105: 00000100:00100000:0.0:1789123182.481481:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f342d734840 going to sleep for 11 seconds 00000100:00100000:0.0:1789123182.484828:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d54000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876031381245312:192.168.206.30@tcp:105: 00010000:00010000:0.0:1789123182.484854:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123182.484909:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2355:x1876031364442496:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 3706us (4739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123182.484919:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 47 00000100:00100000:2.0:1789123182.488344:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123182.488500:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364442624 00000100:00100000:3.0:1789123182.488512:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364442624 00002000:00100000:3.0:1789123182.488584:0:6693:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9f34062d8b40 x1876031364442624/t0(0) o4->64de9449-4320-4c9f-abcb-230edd2b11ae@192.168.206.30@tcp:448/0 lens 504/0 e 0 to 0 dl 1789123193 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789123182.488596:0:6693:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9f34062d8b40 with x1876031364442624 ext(0->8) 00002000:00010000:3.0:1789123182.488603:0:6693:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f34062d8b40 00000100:00100000:3.0:1789123182.488679:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 0 00000100:00100000:3.0:1789123182.488691:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2354:x1876031364442624:12345-192.168.206.30@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789123182.497774:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+8:2354:x1876031364442624:12345-192.168.206.30@tcp:4:lhsmtool_posix.0 Request processed in 9071us (9429us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789123182.497787:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 0 00002000:00100000:3.0:1789123182.497797:0:6693:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9f34062d8b40 x1876031364442624/t4294967302(0) o4->64de9449-4320-4c9f-abcb-230edd2b11ae@192.168.206.30@tcp:448/0 lens 504/448 e 0 to 0 dl 1789123193 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789123182.497808:0:6693:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9f34062d8b40 with x1876031364442624 ext(0->8) 00002000:00010000:3.0:1789123182.497814:0:6693:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f34062d8b40 00000100:00100000:2.0:1789123182.500466:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123182.500563:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364442752 00000100:00100000:3.0:1789123182.500575:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364442752 00000100:00100000:3.0:1789123182.500672:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 80 00000100:00100000:3.0:1789123182.500685:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+29:10662:x1876031364442752:12345-192.168.206.30@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789123182.603940:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967341 is committed 00000001:00080000:0.0:1789123182.603964:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000020:00080000:0.0:1789123182.603974:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:0.0:1789123182.603997:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1789123182.604004:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:3.0:1789123182.604696:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+13:10662:x1876031364442752:12345-192.168.206.30@tcp:44:lhsmtool_posix.0 Request processed in 104006us (104233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123182.604709:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 80 00000100:00100000:3.0:1789123182.607288:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789123182.608908:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381245440:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789123182.609006:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123182.609190:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123182.609225:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381245440 00000100:00100000:3.0:1789123182.609234:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381245440 00000100:00100000:3.0:1789123182.609302:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364442880 00000100:00100000:3.0:1789123182.609313:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364442880 00000100:00100000:3.0:1789123182.609337:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789123182.609346:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381245440:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789123182.609590:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789123182.609594:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789123182 00002000:00010000:3.0:1789123182.609596:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789123182.609598:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789123181 -> 1789123182 00002000:00010000:3.0:1789123182.609601:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789123182.609670:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1876031381245440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 323us (664us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789123182.609679:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789123182.609699:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 30 00000100:00100000:3.0:1789123182.609706:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+8:2355:x1876031364442880:12345-192.168.206.30@tcp:16:lhsmtool_posix.0 00000100:00080000:3.0:1789123182.609761:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789123182.618479:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f3410b48780/2, rc 0, transno 4294967303 00000100:00100000:3.0:1789123182.618503:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381245440:0@lo:2:osp-syn-1-0.0 00000020:00080000:2.0:1789123182.618690:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1789123182.618708:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000001:00080000:0.0:1789123182.721330:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1789123182.721350:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1789123182.721892:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2355:x1876031364442880:12345-192.168.206.30@tcp:16:lhsmtool_posix.0 Request processed in 112179us (112698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123182.721908:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 30 00000100:00100000:2.0:1789123182.727378:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123182.730792:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364443136 00000100:00100000:1.0:1789123182.730813:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364443136 00000100:00100000:1.0:1789123182.730886:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 81 00000100:00100000:1.0:1789123182.730898:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+13:10662:x1876031364443136:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789123182.730966:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123182.731001:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc920de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f63e expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123182.731037:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f3411751500) 00010000:00010000:1.0:1789123182.731042:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789123182.731084:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc920f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123182.731101:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc920f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123182.731112:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc920f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789123182.731449:0:5842:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000054c04e7 reply state 000000009d013a6a transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc920f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123182.731462:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789123182.731597:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+14:10662:x1876031364443136:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 700us (4231us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1789123182.731607:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 81 00010000:00010000:1.0:1789123182.734009:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc920f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123182.734029:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc920f3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123182.734037:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc920f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123182.734044:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33800 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123182.734050:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc920f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123182.734074:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc920f3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123182.734094:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f3411751500) 00010000:00010000:1.0:1789123182.734097:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123182.734104:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc920f3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123182.734110:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc920f3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123182.734693:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123182.734801:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364443264 00000100:00100000:3.0:1789123182.734814:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364443264 00000100:00100000:3.0:1789123182.734886:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 31 00000100:00100000:3.0:1789123182.734897:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2354:x1876031364443264:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789123182.735203:0:8519:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789123182.735207:0:8519:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789123182 -> 1789123180 00002000:00010000:3.0:1789123182.735210:0:8519:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789123178 00002000:00010000:3.0:1789123182.735212:0:8519:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789123182 -> 1789123180 00002000:00010000:3.0:1789123182.735215:0:8519:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789123182.735282:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2354:x1876031364443264:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 Request processed in 386us (594us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789123182.735292:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 31 00000100:00100000:0.0:1789123182.753673:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123182.753732:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364443520 00000100:00100000:0.0:1789123182.753743:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364443520 00000100:00100000:0.0:1789123182.753811:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 82 00000100:00100000:0.0:1789123182.753823:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+13:10662:x1876031364443520:12345-192.168.206.30@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789123182.753914:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc920fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.753934:0:7640:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc920bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f630 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.753945:0:7640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc920fa lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.753987:0:7640:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc920bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f630 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.754017:0:7640:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc920bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f630 expref: 13 pid: 5841 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123182.754034:0:7640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1876031381245568:192.168.206.30@tcp:104: 00000100:00100000:0.0:1789123182.754139:0:7640:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f342d734480 going to sleep for 11 seconds 00000100:00100000:0.0:1789123182.762284:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123182.762341:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364443648 00000100:00100000:0.0:1789123182.762351:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364443648 00010000:00010000:0.0:1789123182.762404:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc920bb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f630 expref: 14 pid: 5841 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123182.762455:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 48 00000100:00100000:0.0:1789123182.762467:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d57c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+14:2355:x1876031364443648:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789123182.762484:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123182.762491:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc920bb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f630 expref: 14 pid: 5841 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.762505:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc920bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f630 expref: 14 pid: 5841 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.762533:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f3411751500) 00010000:00010000:0.0:1789123182.762540:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc920fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.762655:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc920fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.762680:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc920fa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.762703:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123182.762766:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d57c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+14:2355:x1876031364443648:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 300us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123182.762775:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 48 00010000:00010000:0.0:1789123182.762911:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc920bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f630 expref: 13 pid: 5841 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123182.762928:0:7640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1876031381245568:192.168.206.30@tcp:104: 00010000:00010000:0.0:1789123182.762956:0:7640:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc920fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.762966:0:7640:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc920fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.762972:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc920fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.763006:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc920fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.763014:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc920fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.763021:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc920fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.763027:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53e00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123182.763039:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc920fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.763049:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc920fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.763058:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f3411751500) 00010000:00010000:0.0:1789123182.763061:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789123182.763065:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc920fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.763071:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc920fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123182.763122:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+12:10662:x1876031364443520:12345-192.168.206.30@tcp:55:lhsmtool_posix.0 Request processed in 9301us (9461us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789123182.763131:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 82 00000100:00100000:0.0:1789123182.768860:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123182.768942:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364443776 00000100:00100000:3.0:1789123182.768955:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364443776 00000100:00100000:3.0:1789123182.769028:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 32 00000100:00100000:3.0:1789123182.769040:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d55e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2355:x1876031364443776:12345-192.168.206.30@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789123182.769099:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d3b54009/0x7e1648d68fc92101 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.769124:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc920ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f64c expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.769135:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789123182.769140:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789123182.769145:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3b54009/0x7e1648d68fc92101 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.769208:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc920ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f64c expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.769224:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc920ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f64c expref: 7 pid: 6688 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123182.769242:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1876031381245696:192.168.206.30@tcp:104: 00000100:00100000:3.0:1789123182.769346:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340e066840 going to sleep for 11 seconds 00000100:00100000:3.0:1789123182.781092:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1876031381245696:192.168.206.30@tcp:104: 00010000:00010000:3.0:1789123182.781129:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d3b54009/0x7e1648d68fc92101 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123182.788095:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123182.792223:0:11614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364443904 00000100:00100000:2.0:1789123182.792241:0:11614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364443904 00010000:00010000:2.0:1789123182.792301:0:11614:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc920ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f64c expref: 8 pid: 6688 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123182.792359:0:11614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 49 00000100:00100000:2.0:1789123182.792370:0:11614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3406287c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+8:2355:x1876031364443904:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789123182.792389:0:11614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123182.792431:0:11614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc920ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f64c expref: 8 pid: 6688 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.792447:0:11614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc920ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f64c expref: 8 pid: 6688 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.792481:0:11614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc920ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f64c expref: 8 pid: 6688 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.792500:0:11614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789123182.792505:0:11614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789123182.792526:0:11614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3b54009/0x7e1648d68fc92101 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.792537:0:11614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3b54009/0x7e1648d68fc92101 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.792582:0:11614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123182.792678:0:11614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3406287c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2355:x1876031364443904:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 309us (4599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123182.792687:0:11614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 49 00010000:00010000:3.0:1789123182.793023:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d3b54009/0x7e1648d68fc92101 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.793034:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3b54009/0x7e1648d68fc92101 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.793063:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d3b54009/0x7e1648d68fc92101 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.793073:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3b54009/0x7e1648d68fc92101 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.793094:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3b54009/0x7e1648d68fc92101 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.793102:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbbc00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:3.0:1789123182.793106:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3b54009/0x7e1648d68fc92101 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.793116:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3b54009/0x7e1648d68fc92101 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.793131:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3b54009/0x7e1648d68fc92101 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.793140:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3b54009/0x7e1648d68fc92101 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123182.793232:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d55e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2355:x1876031364443776:12345-192.168.206.30@tcp:1:lhsmtool_posix.0 Request processed in 24193us (24384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123182.793241:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 32 00000100:00100000:3.0:1789123182.795942:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123182.796022:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364444160 00000100:00100000:2.0:1789123182.796033:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364444160 00000100:00100000:2.0:1789123182.796097:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 83 00000100:00100000:2.0:1789123182.796108:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+12:10662:x1876031364444160:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789123182.796206:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92108 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.796226:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92108 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.796239:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92108 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.796528:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9210f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.796540:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc920c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f637 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.796548:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9210f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.796833:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc920c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f637 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.796849:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc920c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f637 expref: 13 pid: 5841 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123182.796866:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876031381245824:192.168.206.30@tcp:104: 00000100:00100000:2.0:1789123182.796963:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3303e6c900 going to sleep for 11 seconds 00000100:00100000:3.0:1789123182.807852:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123182.807884:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364444288 00000100:00100000:3.0:1789123182.807894:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364444288 00010000:00010000:3.0:1789123182.807938:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc920c9 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f637 expref: 14 pid: 5841 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123182.807992:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 50 00000100:00100000:3.0:1789123182.808002:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355f2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+14:2354:x1876031364444288:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789123182.808018:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123182.808026:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc920c9 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f637 expref: 14 pid: 5841 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.808040:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc920c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f637 expref: 14 pid: 5841 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.808067:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f3411751500) 00010000:00010000:3.0:1789123182.808073:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9210f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.808084:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9210f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.808092:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9210f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.808112:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789123182.808168:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355f2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+14:2354:x1876031364444288:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 167us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123182.808176:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 50 00010000:00010000:3.0:1789123182.808314:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc920c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f637 expref: 13 pid: 5841 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123182.808331:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876031381245824:192.168.206.30@tcp:104: 00010000:00010000:3.0:1789123182.808361:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9210f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.808371:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9210f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.808376:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9210f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789123182.808622:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1789123182.808827:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1789123182.808875:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1789123182.808967:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1876031381245952:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789123182.811139:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123182.811196:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340e066cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123182.813448:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381245952 00000100:00100000:1.0:1789123182.813465:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381245952 00000100:00100000:1.0:1789123182.813530:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789123182.813541:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1876031381245952:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789123182.813720:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1876031381245952:12345-0@lo:1000:mdt00_002.0 Request processed in 179us (2589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123182.813728:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789123182.815152:0:5842:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1789123182.815164:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f3410b48780, transno 4294967303 00000100:00100000:3.0:1789123182.815185:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1876031381245952:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789123182.818452:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1789123182.818954:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1876031381246080:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789123182.819049:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123182.819137:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340e066840 going to sleep for 11 seconds 00000100:00100000:1.0:1789123182.831729:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381246080 00000100:00100000:1.0:1789123182.831751:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381246080 00000100:00100000:1.0:1789123182.831838:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789123182.831851:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1876031381246080:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789123182.832226:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5842:x1876031381246080:12345-0@lo:1000:mdt00_002.0 Request processed in 377us (13176us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789123182.832235:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789123182.834616:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1876031381246080:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1789123182.834701:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9210f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.834713:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9210f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.834741:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9210f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.834748:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123182.834753:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9210f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.834762:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9210f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.834781:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f3411751500) 00010000:00010000:3.0:1789123182.834785:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789123182.834790:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9210f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.834798:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9210f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.834862:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc92044 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.834869:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc92044 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.834875:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc92044 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.834881:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fba000 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123182.834884:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc92044 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.834902:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc92044 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.834911:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f3411751b00) 00010000:00010000:3.0:1789123182.834914:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789123182.834917:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc92044 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.834922:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc92044 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.834947:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92116 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.834962:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc92060 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f61b expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.834971:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92116 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.835017:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc92060 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f61b expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123182.835035:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc92060 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f61b expref: 16 pid: 5842 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123182.835051:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876031381246208:192.168.206.30@tcp:104: 00000100:00100000:3.0:1789123182.835153:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340e066840 going to sleep for 11 seconds 00000100:00100000:0.0:1789123182.846506:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123182.846542:0:11614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364444416 00000100:00100000:0.0:1789123182.846552:0:11614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364444416 00010000:00010000:0.0:1789123182.846597:0:11614:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc92060 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f61b expref: 17 pid: 5842 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123182.846721:0:11614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 51 00000100:00100000:0.0:1789123182.846732:0:11614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d56d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+17:2355:x1876031364444416:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789123182.846748:0:11614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123182.846755:0:11614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc92060 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f61b expref: 17 pid: 5842 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.846786:0:11614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc92060 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f61b expref: 17 pid: 5842 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.846816:0:11614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f3411751b00) 00010000:00010000:0.0:1789123182.846823:0:11614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92116 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.846835:0:11614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92116 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.846843:0:11614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92116 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.846865:0:11614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123182.846918:0:11614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d56d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+17:2355:x1876031364444416:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 187us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123182.846926:0:11614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 51 00010000:00010000:2.0:1789123182.847039:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc92060 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f61b expref: 16 pid: 5842 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123182.847055:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876031381246208:192.168.206.30@tcp:104: 00010000:00010000:2.0:1789123182.847077:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92116 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.847087:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92116 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.847093:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92116 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.847105:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92116 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.847112:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92116 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.847120:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92116 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.847133:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbbc00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123182.847137:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92116 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.847146:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92116 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.847156:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f3411751b00) 00010000:00010000:2.0:1789123182.847160:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123182.847164:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92116 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.847171:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92116 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.847183:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92108 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.847189:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92108 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.847196:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92108 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.847201:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80bc00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123182.847204:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92108 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.847210:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92108 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.847228:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f3411751b00) 00010000:00010000:2.0:1789123182.847230:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789123182.847233:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92108 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.847240:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92108 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123182.847484:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+15:10662:x1876031364444160:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 51377us (51552us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1789123182.847494:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 83 00000020:00080000:2.0:1789123182.847497:0:5842:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789123182.847833:0:12081:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789123182.847839:0:12081:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789123182.847876:0:12081:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789123182.847881:0:12081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789123182.851715:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123182.851804:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364444672 00000100:00100000:2.0:1789123182.851815:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364444672 00000100:00100000:2.0:1789123182.851877:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 20 00000100:00100000:2.0:1789123182.851889:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+15:10662:x1876031364444672:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789123182.852822:0:5844:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789123182.852924:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1789123182.852978:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc9211d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.852996:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc9211d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.853010:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc9211d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.853020:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc9211d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.853037:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc9211d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.853044:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc9211d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123182.853071:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789123182.853197:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+17:10662:x1876031364444672:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 Request processed in 1306us (1491us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1789123182.853209:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 20 00000020:00080000:2.0:1789123182.853216:0:5844:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789123182.853357:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789123182.853366:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc9211d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.853375:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a800 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:0.0:1789123182.853379:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc9211d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.853398:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc9211d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.853425:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:0.0:1789123182.853429:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789123182.853435:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc9211d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.853442:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc9211d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123182.853458:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123182.853460:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123182.853462:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123183.109790:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789123183.222667:0:12397:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789123183.222675:0:12397:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789123183.222713:0:12397:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789123183.222718:0:12397:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789123183.379196:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123183.379272:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364444928 00000100:00100000:2.0:1789123183.379283:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364444928 00000100:00100000:2.0:1789123183.379353:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 84 00000100:00100000:2.0:1789123183.379363:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+17:10673:x1876031364444928:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1789123183.379387:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123183.379415:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92124 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f653 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123183.379683:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc9212b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123183.379697:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc9212b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123183.379708:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc9212b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123183.379731:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1789123183.379900:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92124 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f653 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123183.379918:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc9212b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f653 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123183.379926:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:2.0:1789123183.379929:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789123183.379932:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80a800, rc 0) 00000100:00100000:2.0:1789123183.379988:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+19:10673:x1876031364444928:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 625us (800us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1789123183.379995:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 84 00000100:00100000:3.0:1789123183.385869:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123183.385926:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364445056 00000100:00100000:3.0:1789123183.385938:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364445056 00000100:00100000:3.0:1789123183.386010:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 85 00000100:00100000:3.0:1789123183.386022:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+19:10673:x1876031364445056:12345-192.168.206.30@tcp:34:lfs.0 00010000:00010000:3.0:1789123183.386117:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc92139 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.386183:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc92139 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.386197:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc92139 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.386215:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc92140 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.386229:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc92140 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.386235:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc92140 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.387215:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc92147 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.387228:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc92147 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.387236:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc92147 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789123183.387298:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc92147 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.387323:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc92139 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.387330:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc92139 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.387336:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc92139 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.387342:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbb400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123183.387347:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc92139 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.387355:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc92139 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.387369:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:3.0:1789123183.387372:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123183.387377:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc92139 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.387383:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc92139 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.387396:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc92140 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.387403:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc92140 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.387428:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc92140 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.387434:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fba000 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123183.387438:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc92140 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.387445:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc92140 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.387457:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f3411751500) 00010000:00010000:3.0:1789123183.387460:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123183.387465:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc92140 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.387471:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc92140 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.387490:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc92147 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.387496:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc92147 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.387502:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc92147 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.387507:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbb600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123183.387510:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc92147 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.387527:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc92147 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.387535:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f3411751900) 00010000:00010000:3.0:1789123183.387538:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123183.387541:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc92147 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.387547:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc92147 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123183.387704:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+19:10673:x1876031364445056:12345-192.168.206.30@tcp:34:lfs.0 Request processed in 1680us (1847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123183.387715:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 85 00000100:00100000:3.0:1789123183.445079:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123183.445243:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364445312 00000100:00100000:0.0:1789123183.445254:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364445312 00000100:00100000:0.0:1789123183.445316:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 86 00000100:00100000:0.0:1789123183.445326:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+19:10676:x1876031364445312:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:0.0:1789123183.445345:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123183.445365:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53200/0x7e1648d68fc9214e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f65a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.445446:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc92155 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.445480:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc92155 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.445491:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc92155 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.445507:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc9215c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.445515:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc9215c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.445522:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc9215c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.445850:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92163 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.445859:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.445868:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123183.445877:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1789123183.446343:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc92155 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.446352:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc92155 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.446358:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc92155 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.446371:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123183.446376:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc92155 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.446384:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc92155 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.446397:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:0.0:1789123183.446400:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123183.446404:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc92155 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.446421:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc92155 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.446434:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc9215c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.446440:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc9215c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.446446:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc9215c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.446451:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53c00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123183.446454:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc9215c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.446460:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc9215c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.446480:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f34226c1f00) 00010000:00010000:0.0:1789123183.446482:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123183.446485:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc9215c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.446491:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc9215c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.461899:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53200/0x7e1648d68fc9214e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f65a expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.461971:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f65a expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.461981:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f34226c1800) 00010000:00010000:1.0:1789123183.461984:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789123183.461988:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b52a00, rc 0) 00000100:00100000:1.0:1789123183.462064:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+21:10676:x1876031364445312:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 16739us (16993us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1789123183.462073:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 86 00000100:00100000:2.0:1789123183.472886:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123183.472934:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364445440 00000100:00100000:2.0:1789123183.472944:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364445440 00000100:00100000:2.0:1789123183.472997:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 87 00000100:00100000:2.0:1789123183.473008:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+21:10676:x1876031364445440:12345-192.168.206.30@tcp:54:lfs.0 00010000:00010000:2.0:1789123183.473139:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc92171 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123183.473161:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc92171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123183.473185:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc92171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123183.473515:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc92171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123183.473524:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc92171 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123183.473540:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc92171 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123183.473547:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123183.473551:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc92171 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123183.473559:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc92171 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123183.473572:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f34226c1800) 00010000:00010000:2.0:1789123183.473575:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789123183.473950:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc92171 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123183.473959:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc92171 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123183.474029:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+21:10676:x1876031364445440:12345-192.168.206.30@tcp:54:lfs.0 Request processed in 1020us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123183.474089:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 87 00000100:00100000:3.0:1789123183.482320:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123183.482880:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364445696 00000100:00100000:2.0:1789123183.482890:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364445696 00000100:00100000:2.0:1789123183.482940:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 21 00000100:00100000:2.0:1789123183.482949:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427abf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+21:10676:x1876031364445696:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:2.0:1789123183.485916:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427abf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+22:10676:x1876031364445696:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 2961us (3597us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1789123183.485928:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 21 00000100:00100000:2.0:1789123183.521104:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123183.521150:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123183.521179:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123183.521212:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123183.521240:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364446080 00000100:00100000:2.0:1789123183.521249:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364446080 00000100:00100000:2.0:1789123183.521294:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364445952 00000100:00100000:2.0:1789123183.521297:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364445952 00000100:00100000:2.0:1789123183.521323:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 66 00000100:00100000:2.0:1789123183.521331:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2355:x1876031364446080:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1789123183.521418:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2355:x1876031364446080:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 86us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123183.521425:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 66 00000100:00100000:2.0:1789123183.521440:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 67 00000100:00100000:2.0:1789123183.521446:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2355:x1876031364445952:12345-192.168.206.30@tcp:400:kworker.0 00000100:00080000:3.0:1789123183.521562:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789123183.521574:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364446208 00000100:00100000:3.0:1789123183.521577:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364446208 00000100:00100000:3.0:1789123183.521608:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 140 00000100:00100000:3.0:1789123183.521614:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2355:x1876031364446208:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123183.521776:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364445824 00000100:00100000:1.0:1789123183.521780:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364445824 00000100:00100000:1.0:1789123183.521806:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 313 00000100:00100000:1.0:1789123183.521823:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+13:2355:x1876031364445824:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1789123183.521875:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2355:x1876031364445952:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 22us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123183.521882:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 67 00000100:00100000:3.0:1789123183.522127:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2355:x1876031364446208:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 512us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123183.522134:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 140 00000100:00080000:3.0:1789123183.522150:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789123183.527665:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+13:2355:x1876031364445824:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 5808us (6526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123183.527678:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 313 00000100:00100000:2.0:1789123183.546384:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123183.546949:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364446464 00000100:00100000:3.0:1789123183.546966:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364446464 00000100:00100000:3.0:1789123183.547047:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 88 00000100:00100000:3.0:1789123183.547093:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343fc04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+22:10204:x1876031364446464:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:3.0:1789123183.547127:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123183.547595:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc92178 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f661 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.547846:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc9217f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.547864:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92163 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f65a expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.547874:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc9217f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.547924:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f65a expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.547940:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92163 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f65a expref: 23 pid: 5840 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123183.547959:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876031381246336:192.168.206.30@tcp:104: 00000100:00100000:3.0:1789123183.548287:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340e066840 going to sleep for 11 seconds 00000100:00100000:3.0:1789123183.563384:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123183.563560:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876031381246336:192.168.206.30@tcp:104: 00010000:00010000:2.0:1789123183.563595:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc9217f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123183.563782:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364446592 00000100:00100000:0.0:1789123183.563790:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364446592 00010000:00010000:0.0:1789123183.563837:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92163 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f65a expref: 24 pid: 5840 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123183.563881:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 52 00000100:00100000:0.0:1789123183.563893:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+24:2355:x1876031364446592:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789123183.563913:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123183.563921:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92163 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f65a expref: 24 pid: 5840 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.563935:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f65a expref: 24 pid: 5840 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.563962:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92163 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f65a expref: 24 pid: 5840 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.563981:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f34226c1800) 00010000:00010000:0.0:1789123183.563986:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc9217f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.564012:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc9217f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.564020:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc9217f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.564053:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123183.564129:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+23:2355:x1876031364446592:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 237us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123183.564137:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 52 00010000:00010000:2.0:1789123183.564269:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc9217f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123183.564277:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc9217f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123183.564308:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789123183.564531:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc92178 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f661 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123183.564551:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc9217f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f661 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123183.564559:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f34226c1800) 00010000:00010000:2.0:1789123183.564562:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789123183.564565:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fba000, rc 0) 00000100:00100000:2.0:1789123183.564612:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343fc04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+23:10204:x1876031364446464:12345-192.168.206.30@tcp:101:bash.0 Request processed in 17523us (18236us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1789123183.564621:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 88 00000100:00100000:0.0:1789123183.576677:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123183.583950:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364446848 00000100:00100000:3.0:1789123183.583973:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364446848 00000100:00100000:3.0:1789123183.584065:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 89 00000100:00100000:3.0:1789123183.584078:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+23:10204:x1876031364446848:12345-192.168.206.30@tcp:36:bash.0 00010000:00010000:3.0:1789123183.584872:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc9218d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.584909:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc9218d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.584924:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc9218d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789123183.584994:0:7640:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1789123183.585023:0:7640:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004a16ac71 reply state 00000000bb935b44 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc9218d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123183.585034:0:7640:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789123183.585093:0:7640:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1789123183.585247:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+27:10204:x1876031364446848:12345-192.168.206.30@tcp:36:bash.0 Request processed in 1168us (8581us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1789123183.585256:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 89 00000020:00080000:3.0:1789123183.585263:0:7640:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1789123183.593585:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc9218d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.593602:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc9218d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.593609:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc9218d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.593615:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbb400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123183.593619:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc9218d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.593905:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc9218d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.593946:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f34226c1800) 00010000:00010000:3.0:1789123183.593949:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123183.593965:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc9218d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.593972:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc9218d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123183.594205:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123183.594284:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364446976 00000100:00100000:2.0:1789123183.594292:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364446976 00000100:00100000:2.0:1789123183.594352:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 90 00000100:00100000:2.0:1789123183.594361:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+26:10204:x1876031364446976:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:2.0:1789123183.594380:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123183.594414:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc92194 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f668 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123183.594470:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc92194 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f668 expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123183.594483:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc92194 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f668 expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123183.594527:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f34226c1800) 00010000:00010000:2.0:1789123183.594530:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789123183.594533:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80aa00, rc 0) 00000100:00100000:2.0:1789123183.594588:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+27:10204:x1876031364446976:12345-192.168.206.30@tcp:101:bash.0 Request processed in 227us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123183.594594:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 90 00000100:00100000:2.0:1789123183.603513:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123183.603771:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364447104 00000100:00100000:3.0:1789123183.603780:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364447104 00000100:00100000:3.0:1789123183.603828:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 33 00000100:00100000:3.0:1789123183.603838:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343fc05a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+6:10204:x1876031364447104:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:3.0:1789123183.603854:0:8519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123183.603874:0:8519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2281af9/0x7e1648d68fc9219b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f66f expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789123183.603901:0:8519:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa3da6c, atime: 0x6aa3da6a, ctime: 0x6aa3da6c, blocks: 0xb 00010000:00010000:3.0:1789123183.603920:0:8519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=297s v=(0 0) 00010000:00010000:3.0:1789123183.603925:0:8519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789123183.603934:0:8519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2281af9/0x7e1648d68fc9219b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f66f expref: 7 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.603949:0:8519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a2281af9/0x7e1648d68fc9219b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f66f expref: 7 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.603972:0:8519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbac00, rc 0) 00000100:00100000:3.0:1789123183.604029:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343fc05a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+7:10204:x1876031364447104:12345-192.168.206.30@tcp:101:bash.0 Request processed in 192us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123183.604053:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 33 00000100:00100000:1.0:1789123183.607903:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123183.609135:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364447232 00000100:00100000:0.0:1789123183.609152:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364447232 00002000:00010000:0.0:1789123183.609201:0:6691:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1789123183.609207:0:6691:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9f342d74f840 with x1876031364447232 ext(0->18446744073709551615) 00002000:00010000:0.0:1789123183.609221:0:6691:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f342d74f840. 00000100:00100000:0.0:1789123183.609260:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 1 00000100:00100000:0.0:1789123183.609270:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2353:x1876031364447232:12345-192.168.206.30@tcp:10:bash.0 00002000:00010000:0.0:1789123183.609720:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789123183.609726:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789123180 -> 1789123183 00002000:00010000:0.0:1789123183.609728:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789123178 -> 1789123178 00002000:00010000:0.0:1789123183.609731:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789123180 -> 1789123183 00002000:00010000:0.0:1789123183.609734:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789123183.609819:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+8:2353:x1876031364447232:12345-192.168.206.30@tcp:10:bash.0 Request processed in 549us (1924us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789123183.609830:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 1 00002000:00010000:0.0:1789123183.609846:0:6691:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1789123183.609849:0:6691:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9f342d74f840 with x1876031364447232 ext(0->18446744073709551615) 00002000:00010000:0.0:1789123183.609855:0:6691:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f342d74f840. 00000100:00100000:0.0:1789123183.730474:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123183.735596:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364447360 00000100:00100000:1.0:1789123183.735610:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364447360 00000100:00100000:1.0:1789123183.735698:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 91 00000100:00100000:1.0:1789123183.735709:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+27:10690:x1876031364447360:12345-192.168.206.30@tcp:34:lfs.0 00010000:00010000:1.0:1789123183.735779:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc921a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.735817:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc921a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.735845:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc921a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.735860:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc921a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.735868:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc921a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.735875:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc921a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.736136:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc921b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.736145:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc921b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.736152:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc921b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789123183.736185:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc921b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.736195:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc921a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.736201:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc921a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.736216:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc921a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.737946:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32c00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123183.737952:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc921a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.737971:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc921a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.737985:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:1.0:1789123183.737988:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123183.737993:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc921a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.738000:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc921a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.738014:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc921a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.738021:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc921a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.738026:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc921a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.738032:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32e00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123183.738035:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc921a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.738056:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc921a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.738063:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f340534d100) 00010000:00010000:1.0:1789123183.738065:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123183.738068:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc921a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.738074:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc921a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.738088:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc921b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.738093:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc921b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.738099:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc921b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.738104:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33200 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123183.738106:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc921b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.738112:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc921b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.738117:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f34226c1800) 00010000:00010000:1.0:1789123183.738119:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123183.738122:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc921b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.738134:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc921b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123183.739175:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+27:10690:x1876031364447360:12345-192.168.206.30@tcp:34:lfs.0 Request processed in 2509us (7768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123183.739190:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 91 00000100:00100000:2.0:1789123183.788396:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123183.790940:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364447616 00000100:00100000:3.0:1789123183.790963:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364447616 00000100:00100000:3.0:1789123183.791069:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 92 00000100:00100000:3.0:1789123183.791082:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+27:10693:x1876031364447616:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:3.0:1789123183.791111:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123183.791140:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc921b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f676 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.791898:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc921be lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.791921:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc921be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.791935:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc921be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.791956:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc921c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.791963:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc921c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.791970:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc921c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.792990:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc921cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.793019:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc921cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.793030:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc921cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123183.793044:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789123183.793434:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc921be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.793443:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc921be lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.793460:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc921be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.794486:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbae00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123183.794494:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc921be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.794504:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc921be lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.794522:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:3.0:1789123183.794526:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123183.794531:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc921be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.794547:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc921be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.794565:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc921c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.794591:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc921c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.794599:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc921c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.794604:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbb600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123183.794607:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc921c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.794613:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc921c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.794621:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f3411751800) 00010000:00010000:3.0:1789123183.794624:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123183.794668:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc921c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.794674:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc921c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.794745:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc921b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f676 expref: 30 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.794759:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc921cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f676 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.794768:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f34226c1800) 00010000:00010000:3.0:1789123183.794770:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789123183.794778:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbbc00, rc 0) 00000100:00100000:3.0:1789123183.794872:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+29:10693:x1876031364447616:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 3793us (6489us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1789123183.794882:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 92 00000100:00100000:2.0:1789123183.800527:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123183.803267:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364447744 00000100:00100000:3.0:1789123183.803286:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364447744 00000100:00100000:3.0:1789123183.804850:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 93 00000100:00100000:3.0:1789123183.804881:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c305680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+29:10693:x1876031364447744:12345-192.168.206.30@tcp:54:lfs.0 00010000:00010000:3.0:1789123183.804973:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc921da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.804993:0:7640:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc9217f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f661 expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.805004:0:7640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc921da lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.805049:0:7640:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc9217f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f661 expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.805065:0:7640:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc9217f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f661 expref: 29 pid: 5842 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123183.805081:0:7640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1876031381246464:192.168.206.30@tcp:104: 00000100:00100000:3.0:1789123183.805218:0:7640:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340e066840 going to sleep for 11 seconds 00000100:00100000:0.0:1789123183.814578:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123183.814793:0:7640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1876031381246464:192.168.206.30@tcp:104: 00010000:00010000:3.0:1789123183.814827:0:7640:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc921da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123183.815088:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364448000 00000100:00100000:2.0:1789123183.815097:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364448000 00000100:00100000:2.0:1789123183.815172:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 22 00000100:00100000:2.0:1789123183.815184:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+30:5589:x1876031364448000:12345-192.168.206.30@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789123183.816277:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+31:5589:x1876031364448000:12345-192.168.206.30@tcp:35:ldlm_bl.0 Request processed in 1086us (1710us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1789123183.816290:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 22 00000100:00100000:2.0:1789123183.831895:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123183.832166:0:11614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364448128 00000100:00100000:0.0:1789123183.832180:0:11614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364448128 00010000:00010000:0.0:1789123183.832237:0:11614:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc9217f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f661 expref: 31 pid: 5842 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123183.832291:0:11614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 53 00000100:00100000:0.0:1789123183.832303:0:11614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c3043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+31:2354:x1876031364448128:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789123183.832322:0:11614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123183.832330:0:11614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc9217f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f661 expref: 31 pid: 5842 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.832345:0:11614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc9217f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f661 expref: 31 pid: 5842 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.832377:0:11614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc9217f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f661 expref: 31 pid: 5842 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.832395:0:11614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f34226c1800) 00010000:00010000:0.0:1789123183.832400:0:11614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc921da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.832424:0:11614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc921da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.832451:0:11614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc921da lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123183.832498:0:11614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123183.832579:0:11614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c3043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+30:2354:x1876031364448128:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 269us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123183.832588:0:11614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 53 00010000:00010000:1.0:1789123183.832733:0:7640:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc921da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.832742:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc921da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.832781:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc921da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.832788:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc921da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.832796:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc921da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.832803:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbb400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123183.832807:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc921da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.832816:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc921da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.832827:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f34226c1800) 00010000:00010000:1.0:1789123183.832830:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789123183.832843:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc921da lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123183.832849:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc921da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123183.832907:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c305680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+29:10693:x1876031364447744:12345-192.168.206.30@tcp:54:lfs.0 Request processed in 28035us (32396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123183.832916:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 93 00000100:00100000:0.0:1789123183.838550:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123183.839097:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364448384 00000100:00100000:3.0:1789123183.839110:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364448384 00000100:00100000:3.0:1789123183.839184:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 23 00000100:00100000:3.0:1789123183.839196:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+29:10693:x1876031364448384:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:3.0:1789123183.840277:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+30:10693:x1876031364448384:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 1073us (1742us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1789123183.840290:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 23 00000100:00100000:2.0:1789123183.969338:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123183.971886:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364448640 00000100:00100000:3.0:1789123183.971905:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364448640 00000100:00100000:3.0:1789123183.971986:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 94 00000100:00100000:3.0:1789123183.971997:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c305e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+30:10704:x1876031364448640:12345-192.168.206.30@tcp:101:cat.0 00010000:00010000:3.0:1789123183.972027:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123183.972054:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc921e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f67d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.972141:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc921e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.972159:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc921e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.972171:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc921e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.972185:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc921ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.972192:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc921ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.972213:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc921ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.972846:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc921f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.972911:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc921f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.972921:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc921f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123183.972932:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1789123183.973040:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc921e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.973049:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc921e8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.973056:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc921e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.973062:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbae00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123183.973067:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc921e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.973075:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc921e8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.973088:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:3.0:1789123183.973091:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123183.973102:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc921e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.973109:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc921e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.973122:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc921ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.973129:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc921ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.973135:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc921ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.973140:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbb800 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123183.973142:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc921ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.973148:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc921ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.973154:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f3411751800) 00010000:00010000:3.0:1789123183.973156:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123183.973159:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc921ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.973164:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc921ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.973212:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc921e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f67d expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.973235:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc921f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f67d expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123183.973243:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f34226c1800) 00010000:00010000:3.0:1789123183.973245:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789123183.973248:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fba400, rc 0) 00000100:00100000:3.0:1789123183.973319:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c305e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+32:10704:x1876031364448640:12345-192.168.206.30@tcp:101:cat.0 Request processed in 1324us (3996us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1789123183.973327:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 94 00000100:00100000:0.0:1789123183.978375:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123183.978502:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364448896 00000100:00100000:2.0:1789123183.978515:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364448896 00000100:00100000:2.0:1789123183.978595:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 24 00000100:00100000:2.0:1789123183.978607:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+32:10704:x1876031364448896:12345-192.168.206.30@tcp:35:cat.0 00000100:00100000:2.0:1789123183.979370:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+33:10704:x1876031364448896:12345-192.168.206.30@tcp:35:cat.0 Request processed in 760us (1014us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1789123183.979399:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 24 00000100:00100000:0.0:1789123184.012981:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123184.013149:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364449152 00000100:00100000:1.0:1789123184.013163:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364449152 00000100:00100000:1.0:1789123184.013247:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 95 00000100:00100000:1.0:1789123184.013258:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+33:10705:x1876031364449152:12345-192.168.206.30@tcp:36:rm.0 00010000:00010000:1.0:1789123184.013323:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789123184.013363:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc921f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f67d expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.013387:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc921cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f676 expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.013401:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc92194 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f668 expref: 31 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.013422:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f34226c1800) 00010000:00010000:1.0:1789123184.013441:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789123184.013473:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc92204 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.013488:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc92204 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.013512:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc92204 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.013528:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9220b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.013536:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9220b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.013542:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9220b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.014343:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92212 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.014367:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92212 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.014376:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92212 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789123184.015578:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1789123184.018580:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1789123184.018597:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 298348968357ns, next at 299348964736ns, rc = 0 00010000:00010000:1.0:1789123184.018715:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92219 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.018735:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92219 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.018748:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92219 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.018769:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92219 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.018777:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92219 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.018784:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92219 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.018818:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789123184.018850:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92212 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.018855:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92212 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.018859:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92212 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.018866:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32c00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123184.018871:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92212 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.018879:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92212 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.018894:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f340534df00) 00010000:00010000:1.0:1789123184.018899:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789123184.018904:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92212 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.018919:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92212 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.018942:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc92204 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.018947:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc92204 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.018953:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc92204 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.018957:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33200 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123184.018960:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc92204 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.018966:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc92204 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.018975:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:1.0:1789123184.018977:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123184.018980:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc92204 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.018985:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc92204 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789123184.018997:0:5840:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000079f5459c reply state 0000000041cf0366 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9220b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123184.019007:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789123184.019145:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+32:10705:x1876031364449152:12345-192.168.206.30@tcp:36:rm.0 Request processed in 5882us (6170us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1789123184.019156:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 95 00010000:00010000:3.0:1789123184.019818:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789123184.019828:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92219 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.019837:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32400 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:3.0:1789123184.019841:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92219 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.019848:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92219 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.019872:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f340534df00) 00010000:00010000:3.0:1789123184.019875:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789123184.019879:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92219 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.019886:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92219 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.019925:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123184.019927:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123184.019928:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123184.025261:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9220b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.025283:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9220b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.025292:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9220b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.025300:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32e00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123184.025305:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9220b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.025313:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9220b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.025334:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f340534d100) 00010000:00010000:1.0:1789123184.032591:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123184.032608:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9220b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.032620:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9220b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123184.082046:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123184.082761:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364449408 00000100:00100000:3.0:1789123184.082775:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364449408 00000100:00100000:3.0:1789123184.082857:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 96 00000100:00100000:3.0:1789123184.082868:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+31:10711:x1876031364449408:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:3.0:1789123184.082897:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123184.082925:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc92220 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f684 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.083089:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc92227 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.083107:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc92227 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.083120:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc92227 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.083138:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc9222e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.083145:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc9222e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.083152:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc9222e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789123184.083964:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1789123184.084188:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92235 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.084201:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.084211:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.084249:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc92227 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.084256:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc92227 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.084264:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc92227 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.084271:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbb800 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123184.084276:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc92227 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.084285:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc92227 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.084311:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:2.0:1789123184.084314:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123184.084319:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc92227 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.084339:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc92227 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789123184.084355:0:5842:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000d23299e8 reply state 00000000acad6db7 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc9222e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123184.084365:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789123184.084413:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc92220 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f684 expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.084430:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92235 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f684 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.084437:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f34232f7300) 00010000:00010000:2.0:1789123184.084439:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789123184.084442:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80a200, rc 0) 00000100:00100000:2.0:1789123184.084535:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+34:10711:x1876031364449408:12345-192.168.206.30@tcp:101:bash.0 Request processed in 1668us (2503us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1789123184.084545:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 96 00000100:00100000:2.0:1789123184.088152:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123184.088232:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364449536 00000100:00100000:0.0:1789123184.088244:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364449536 00000100:00100000:0.0:1789123184.088329:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 34 00000100:00100000:0.0:1789123184.088340:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2355:x1876031364449536:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:0.0:1789123184.088363:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123184.088387:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7816300/0x7e1648d68fc92243 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f68b expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789123184.088431:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789123184.088455:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=298s v=(0 0) 00010000:00010000:0.0:1789123184.088460:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123184.088471:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7816300/0x7e1648d68fc92243 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f68b expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123184.088493:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b7816300/0x7e1648d68fc92243 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f68b expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123184.088524:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53c00, rc 0) 00000100:00100000:0.0:1789123184.088595:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+8:2355:x1876031364449536:12345-192.168.206.30@tcp:101:bash.0 Request processed in 256us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123184.088603:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 34 00010000:00010000:3.0:1789123184.088722:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc9222e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.088740:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc9222e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.088747:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc9222e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.088754:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbae00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123184.088760:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc9222e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.088770:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc9222e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.088785:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f3411751800) 00010000:00010000:3.0:1789123184.088789:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123184.088794:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc9222e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.088800:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc9222e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123184.096622:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123184.099950:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364449664 00000100:00100000:3.0:1789123184.099969:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364449664 00000100:00100000:2.0:1789123184.104323:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 35 00000100:00100000:2.0:1789123184.104341:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+8:10711:x1876031364449664:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:2.0:1789123184.104367:0:8519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123184.104394:0:8519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b48074b6/0x7e1648d68fc9224a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f692 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.104446:0:8519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7816300/0x7e1648d68fc92243 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f68b expref: 9 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.104469:0:8519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789123184.104474:0:8519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789123184.104481:0:8519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b48074b6/0x7e1648d68fc9224a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f692 expref: 9 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.104524:0:8519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b7816300/0x7e1648d68fc92243 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f68b expref: 9 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.104540:0:8519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b7816300/0x7e1648d68fc92243 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f68b expref: 9 pid: 6688 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123184.104557:0:8519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c306940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8519:1876031381246592:192.168.206.30@tcp:104: 00000100:00100000:2.0:1789123184.104695:0:8519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3303e6c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789123184.107268:0:8519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c306940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8519:1876031381246592:192.168.206.30@tcp:104: 00010000:00010000:0.0:1789123184.107325:0:8519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b48074b6/0x7e1648d68fc9224a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f692 expref: 9 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123184.107351:0:8519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80ae00, rc 0) 00000100:00100000:0.0:1789123184.107430:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+9:10711:x1876031364449664:12345-192.168.206.30@tcp:101:bash.0 Request processed in 3093us (10822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123184.107441:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 35 00000100:00100000:0.0:1789123184.109366:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123184.109471:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364449792 00000100:00100000:3.0:1789123184.109483:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364449792 00010000:00010000:3.0:1789123184.109532:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b7816300/0x7e1648d68fc92243 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f68b expref: 9 pid: 6688 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123184.109581:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 54 00000100:00100000:3.0:1789123184.109591:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+9:2355:x1876031364449792:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789123184.109623:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123184.109687:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b7816300/0x7e1648d68fc92243 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f68b expref: 9 pid: 6688 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.109703:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b7816300/0x7e1648d68fc92243 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f68b expref: 9 pid: 6688 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.109733:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7816300/0x7e1648d68fc92243 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f68b expref: 9 pid: 6688 timeout: 398 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.109752:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789123184.109757:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789123184.109768:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b48074b6/0x7e1648d68fc9224a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f692 expref: 8 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.109779:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b48074b6/0x7e1648d68fc9224a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f692 expref: 8 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.109825:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b48074b6/0x7e1648d68fc9224a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f692 expref: 8 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123184.109841:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f0f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876031381246720:192.168.206.30@tcp:105: 00000100:00100000:3.0:1789123184.109937:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340e066600 going to sleep for 11 seconds 00000100:00100000:3.0:1789123184.115559:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f0f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876031381246720:192.168.206.30@tcp:105: 00010000:00010000:3.0:1789123184.115593:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789123184.115705:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+8:2355:x1876031364449792:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 6113us (6346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123184.115719:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 54 00000100:00100000:2.0:1789123184.129505:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123184.129602:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364450048 00000100:00100000:3.0:1789123184.129616:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364450048 00000100:00100000:2.0:1789123184.129804:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 25 00000100:00100000:2.0:1789123184.129818:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c3070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+33:10711:x1876031364450048:12345-192.168.206.30@tcp:35:bash.0 00000100:00100000:2.0:1789123184.130556:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c3070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+34:10711:x1876031364450048:12345-192.168.206.30@tcp:35:bash.0 Request processed in 484us (807us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1789123184.130569:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 25 00010000:00010000:3.0:1789123184.136091:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789123184.245034:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:3.0:1789123184.245134:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:3.0:1789123184.245228:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:0.0:1789123184.399773:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123184.400427:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364450176 00000100:00100000:2.0:1789123184.400441:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364450176 00000100:00100000:2.0:1789123184.400510:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 97 00000100:00100000:2.0:1789123184.400522:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+34:10727:x1876031364450176:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1789123184.400569:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123184.400597:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92251 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f699 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.402367:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92258 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.402395:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.402420:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123184.402501:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1789123184.402505:0:7640:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789123184.402536:0:7640:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.402576:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92251 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f699 expref: 36 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.402598:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92258 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f699 expref: 35 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.402607:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:2.0:1789123184.402610:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789123184.402614:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80bc00, rc 0) 00000100:00100000:2.0:1789123184.402763:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+35:10727:x1876031364450176:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 2241us (3003us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123184.402773:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 97 00000100:00100000:0.0:1789123184.406284:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123184.406801:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364450432 00000100:00100000:2.0:1789123184.406815:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364450432 00000100:00100000:2.0:1789123184.406896:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 98 00000100:00100000:2.0:1789123184.406908:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+35:10727:x1876031364450432:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1789123184.406933:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123184.406960:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc9225f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f6a0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.407085:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc92266 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.407101:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc92266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.407115:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc92266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123184.407128:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789123184.407305:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc9225f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6a0 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.407325:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc92266 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6a0 expref: 37 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.407334:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f34232f7300) 00010000:00010000:2.0:1789123184.407338:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789123184.407342:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80aa00, rc 0) 00000100:00100000:2.0:1789123184.407432:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+37:10727:x1876031364450432:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 526us (1162us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1789123184.407457:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 98 00000100:00100000:2.0:1789123184.421620:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123184.421772:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123184.421917:0:11614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364450560 00000100:00100000:1.0:1789123184.421929:0:11614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364450560 00000100:00100000:1.0:1789123184.422017:0:11614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 6 00000100:00100000:1.0:1789123184.422028:0:11614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c306580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+37:2355:x1876031364450560:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789123184.422062:0:11614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123184.422093:0:11614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc92266 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6a0 expref: 37 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.422114:0:11614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f34232f7300) 00010000:00010000:1.0:1789123184.422119:0:11614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789123184.422199:0:11614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c306580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+36:2355:x1876031364450560:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 173us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123184.422207:0:11614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 6 00000100:00100000:3.0:1789123184.422489:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364450816 00000100:00100000:3.0:1789123184.422495:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364450816 00000100:00100000:3.0:1789123184.422540:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 99 00000100:00100000:3.0:1789123184.422549:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c3052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+36:10727:x1876031364450816:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:3.0:1789123184.422573:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123184.422591:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92274 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f6a7 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.422744:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc9227b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.422761:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc9227b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.422773:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc9227b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123184.422786:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789123184.422939:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92274 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6a7 expref: 39 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.422971:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc9227b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6a7 expref: 38 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.422979:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f34232f7300) 00010000:00010000:3.0:1789123184.422982:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789123184.422985:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbb200, rc 0) 00000100:00100000:3.0:1789123184.423027:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c3052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+38:10727:x1876031364450816:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 480us (1255us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1789123184.423034:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 99 00000100:00100000:2.0:1789123184.431103:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123184.431195:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364450944 00000100:00100000:1.0:1789123184.431209:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364450944 00000100:00100000:1.0:1789123184.431288:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 36 00000100:00100000:1.0:1789123184.431300:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2354:x1876031364450944:12345-192.168.206.30@tcp:1:lfs.0 00010000:00010000:1.0:1789123184.431362:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009128a704/0x7e1648d68fc92289 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.431386:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b48074b6/0x7e1648d68fc9224a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f692 expref: 6 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.431396:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123184.431411:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789123184.431418:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009128a704/0x7e1648d68fc92289 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.431464:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b48074b6/0x7e1648d68fc9224a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f692 expref: 6 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.431498:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b48074b6/0x7e1648d68fc9224a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f692 expref: 6 pid: 8519 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123184.431517:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d74ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1876031381246848:192.168.206.30@tcp:104: 00000100:00100000:1.0:1789123184.431680:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340555aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789123184.438835:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d74ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1876031381246848:192.168.206.30@tcp:104: 00010000:00010000:1.0:1789123184.438878:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009128a704/0x7e1648d68fc92289 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123184.439828:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123184.443218:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364451072 00000100:00100000:3.0:1789123184.443240:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364451072 00002000:00100000:3.0:1789123184.443319:0:6693:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9f343c305a40 x1876031364451072/t0(0) o4->64de9449-4320-4c9f-abcb-230edd2b11ae@192.168.206.30@tcp:450/0 lens 504/0 e 0 to 0 dl 1789123195 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789123184.443332:0:6693:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9f343c305a40 with x1876031364451072 ext(0->8) 00010000:00010000:3.0:1789123184.443343:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b48074b6/0x7e1648d68fc9224a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f692 expref: 7 pid: 8519 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.443363:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b48074b6/0x7e1648d68fc9224a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f692 expref: 7 pid: 8519 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789123184.443373:0:6693:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9f343c305a40 00000100:00100000:3.0:1789123184.443425:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 1 00000100:00100000:3.0:1789123184.443437:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c305a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2355:x1876031364451072:12345-192.168.206.30@tcp:4:lfs.0 00000100:00100000:3.0:1789123184.444146:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c305a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+9:2355:x1876031364451072:12345-192.168.206.30@tcp:4:lfs.0 Request processed in 707us (4321us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789123184.444163:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 1 00002000:00100000:3.0:1789123184.444172:0:6693:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9f343c305a40 x1876031364451072/t4294967302(0) o4->64de9449-4320-4c9f-abcb-230edd2b11ae@192.168.206.30@tcp:450/0 lens 504/448 e 0 to 0 dl 1789123195 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789123184.444181:0:6693:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9f343c305a40 with x1876031364451072 ext(0->8) 00010000:00010000:3.0:1789123184.444186:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b48074b6/0x7e1648d68fc9224a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f692 expref: 9 pid: 8519 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.444200:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b48074b6/0x7e1648d68fc9224a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f692 expref: 9 pid: 8519 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789123184.444207:0:6693:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9f343c305a40 00000100:00100000:2.0:1789123184.453058:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123184.453177:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364451200 00000100:00100000:1.0:1789123184.453189:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364451200 00010000:00010000:1.0:1789123184.453239:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b48074b6/0x7e1648d68fc9224a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f692 expref: 9 pid: 8519 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123184.453285:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 55 00000100:00100000:1.0:1789123184.453296:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3406284850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+9:2354:x1876031364451200:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789123184.453315:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789123184.453341:0:5824:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789123184.453344:0:5824:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789123183 00002000:00010000:1.0:1789123184.453346:0:5824:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789123184 00002000:00010000:1.0:1789123184.453348:0:5824:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789123183 00010000:00010000:1.0:1789123184.453354:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b48074b6/0x7e1648d68fc9224a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f692 expref: 9 pid: 8519 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.453390:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b48074b6/0x7e1648d68fc9224a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f692 expref: 9 pid: 8519 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.453433:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b48074b6/0x7e1648d68fc9224a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f692 expref: 9 pid: 8519 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.453453:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789123184.453457:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789123184.453464:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009128a704/0x7e1648d68fc92289 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.453474:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009128a704/0x7e1648d68fc92289 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123184.453517:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789123184.453590:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3406284850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+8:2354:x1876031364451200:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 295us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123184.453598:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 55 00010000:00010000:0.0:1789123184.453837:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009128a704/0x7e1648d68fc92289 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123184.453848:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009128a704/0x7e1648d68fc92289 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123184.453877:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009128a704/0x7e1648d68fc92289 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123184.453898:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009128a704/0x7e1648d68fc92289 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123184.453906:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009128a704/0x7e1648d68fc92289 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123184.453913:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33200 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:0.0:1789123184.453917:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009128a704/0x7e1648d68fc92289 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123184.453926:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009128a704/0x7e1648d68fc92289 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123184.453939:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009128a704/0x7e1648d68fc92289 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123184.453947:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009128a704/0x7e1648d68fc92289 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123184.454002:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2354:x1876031364450944:12345-192.168.206.30@tcp:1:lfs.0 Request processed in 22704us (22918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123184.454011:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 36 00000100:00100000:2.0:1789123184.456921:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123184.457701:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364451456 00000100:00100000:0.0:1789123184.457715:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364451456 00000100:00100000:0.0:1789123184.457791:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 26 00000100:00100000:0.0:1789123184.457817:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427abf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+38:10727:x1876031364451456:12345-192.168.206.30@tcp:35:lfs.0 00000004:00010000:0.0:1789123184.457898:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc9227b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6a7 expref: 38 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789123184.458224:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1789123184.458273:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1789123184.458701:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1789123184.458763:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc92290 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123184.458781:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92235 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f684 expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123184.458792:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc92290 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123184.458835:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92235 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f684 expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123184.458851:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92235 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f684 expref: 42 pid: 5842 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123184.458867:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c30cb40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5844:1876031381246976:192.168.206.30@tcp:104: 00000100:00100000:0.0:1789123184.458969:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408f1c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789123184.465516:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123184.466292:0:11614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364451584 00000100:00100000:3.0:1789123184.466306:0:11614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364451584 00010000:00010000:3.0:1789123184.466361:0:11614:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92235 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f684 expref: 43 pid: 5842 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123184.466426:0:11614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 56 00000100:00100000:3.0:1789123184.466438:0:11614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c304780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+43:2354:x1876031364451584:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789123184.466456:0:11614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123184.466464:0:11614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92235 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f684 expref: 43 pid: 5842 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.466479:0:11614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92235 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f684 expref: 43 pid: 5842 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.466505:0:11614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f34232f7300) 00010000:00010000:3.0:1789123184.466523:0:11614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc92290 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.466534:0:11614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc92290 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.466542:0:11614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc92290 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.466564:0:11614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789123184.466667:0:11614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c304780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+43:2354:x1876031364451584:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 190us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123184.466677:0:11614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 56 00010000:00010000:0.0:1789123184.467114:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92235 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f684 expref: 42 pid: 5842 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123184.467134:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c30cb40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5844:1876031381246976:192.168.206.30@tcp:104: 00010000:00010000:0.0:1789123184.467184:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc92290 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123184.467195:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc92290 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123184.467200:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc92290 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789123184.467361:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1789123184.467611:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1789123184.469004:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c30cb40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1876031381247104:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789123184.469093:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123184.469142:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408f1c600 going to sleep for 11 seconds 00000100:00100000:2.0:1789123184.469781:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381247104 00000100:00100000:2.0:1789123184.469793:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381247104 00000100:00100000:2.0:1789123184.469872:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789123184.469884:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1876031381247104:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789123184.469998:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1876031381247104:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 116us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123184.470006:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789123184.470932:0:5844:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1789123184.470942:0:5844:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1789123184.470968:0:5844:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f343568d680, transno 4294967301 00000100:00100000:0.0:1789123184.470995:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c30cb40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1876031381247104:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1789123184.471396:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789123184.472945:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1789123184.473060:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c30cb40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1876031381247232:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789123184.473145:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123184.475457:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408f1c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123184.486441:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381247232 00000100:00100000:1.0:1789123184.486462:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381247232 00000100:00100000:1.0:1789123184.486554:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789123184.486567:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1876031381247232:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789123184.486991:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1876031381247232:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 425us (13845us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789123184.487000:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789123184.487154:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c30cb40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1876031381247232:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789123184.487259:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1789123184.487316:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc92290 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.487327:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc92290 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.487335:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc92290 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.487343:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123184.487348:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc92290 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.487356:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc92290 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.487387:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f34232f7300) 00010000:00010000:3.0:1789123184.487389:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789123184.487397:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc92290 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.487413:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc92290 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789123184.487685:0:5844:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789123184.487801:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1789123184.487814:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 298818185857ns, next at 299818183615ns, rc = 0 00000001:00080000:3.0:1789123184.487822:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1789123184.487859:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f34232f7300) 00010000:00010000:3.0:1789123184.487863:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789123184.487871:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc9227b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6a7 expref: 46 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123184.487993:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427abf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+45:10727:x1876031364451456:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 30178us (31082us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1789123184.488003:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 26 00000020:00080000:3.0:1789123184.488008:0:5844:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789123184.498822:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123184.499713:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364451712 00000100:00100000:3.0:1789123184.499728:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364451712 00000100:00100000:3.0:1789123184.499809:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 100 00000100:00100000:3.0:1789123184.499822:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c307c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+45:10727:x1876031364451712:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:3.0:1789123184.499853:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123184.499885:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92297 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f6ae expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.499987:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92297 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6ae expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.500005:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92297 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6ae expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.500028:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:3.0:1789123184.500032:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789123184.500037:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbae00, rc 0) 00000100:00100000:3.0:1789123184.500119:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c307c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+46:10727:x1876031364451712:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 299us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123184.500128:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 100 00000100:00100000:1.0:1789123184.517583:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123184.517703:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364451968 00000100:00100000:3.0:1789123184.517716:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364451968 00000100:00100000:3.0:1789123184.517792:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 27 00000100:00100000:3.0:1789123184.517804:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+46:10727:x1876031364451968:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:3.0:1789123184.518102:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+47:10727:x1876031364451968:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 298us (533us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1789123184.518111:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 27 00000100:00100000:2.0:1789123184.666433:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123184.666927:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364452096 00000100:00100000:3.0:1789123184.666940:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364452096 00000100:00100000:3.0:1789123184.667023:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 101 00000100:00100000:3.0:1789123184.667037:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c307840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+47:10737:x1876031364452096:12345-192.168.206.30@tcp:34:lfs.0 00010000:00010000:3.0:1789123184.667155:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc9229e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.667196:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc9229e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.667210:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc9229e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.667230:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc922a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.667238:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc922a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.667245:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc922a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.667393:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc922ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.667412:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc922ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.667420:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc922ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789123184.667474:0:7640:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc922ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.667490:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc9229e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.667497:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc9229e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.667515:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc9229e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.667522:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbb200 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123184.667527:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc9229e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.667534:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc9229e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.667549:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:3.0:1789123184.667552:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123184.667558:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc9229e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.667565:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc9229e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.667580:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc922a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.667587:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc922a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.667593:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc922a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.667598:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbb000 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123184.667601:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc922a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.667618:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc922a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.667685:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f3411751800) 00010000:00010000:3.0:1789123184.667689:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123184.667692:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc922a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.667699:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc922a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.667938:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc922ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.667946:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc922ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.667952:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc922ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.667958:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fba200 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123184.667961:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc922ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.667967:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc922ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.667976:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:3.0:1789123184.667979:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123184.667982:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc922ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.668000:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc922ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123184.668124:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c307840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+47:10737:x1876031364452096:12345-192.168.206.30@tcp:34:lfs.0 Request processed in 1086us (1702us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123184.668134:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 101 00000100:00100000:1.0:1789123184.712616:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123184.713098:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364452352 00000100:00100000:3.0:1789123184.713111:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364452352 00000100:00100000:3.0:1789123184.713186:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 102 00000100:00100000:3.0:1789123184.713199:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+47:10740:x1876031364452352:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:3.0:1789123184.713224:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123184.713251:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc922b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f6b5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.713482:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc922ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.713500:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc922ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.713517:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc922ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.713534:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc922c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.713542:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc922c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.713566:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc922c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.715157:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbaa00/0x7e1648d68fc922c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.715177:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbaa00/0x7e1648d68fc922c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.715192:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbaa00/0x7e1648d68fc922c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123184.715206:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789123184.716507:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc922ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.716524:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc922ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.716533:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc922ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.716540:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbb000 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123184.716546:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc922ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.716554:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc922ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.716572:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:3.0:1789123184.716576:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123184.716598:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc922ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.716606:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc922ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.716624:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc922c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.717610:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc922c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.717619:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc922c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.717645:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbb200 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123184.717664:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc922c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.717674:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc922c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.717688:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f3411751800) 00010000:00010000:3.0:1789123184.717691:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123184.717696:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc922c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.717703:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc922c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.717794:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc922b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6b5 expref: 50 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.717833:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbaa00/0x7e1648d68fc922c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6b5 expref: 49 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.717841:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:3.0:1789123184.717844:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789123184.717847:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbaa00, rc 0) 00000100:00100000:3.0:1789123184.717949:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+49:10740:x1876031364452352:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 4751us (5347us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1789123184.717960:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 102 00000100:00100000:0.0:1789123184.727687:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123184.728074:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364452480 00000100:00100000:3.0:1789123184.728088:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364452480 00000100:00100000:3.0:1789123184.728163:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 103 00000100:00100000:3.0:1789123184.728177:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+49:10740:x1876031364452480:12345-192.168.206.30@tcp:54:lfs.0 00010000:00010000:3.0:1789123184.728394:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc922d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.728426:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc922d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.728440:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc922d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.728473:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc922d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.728481:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc922d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.728508:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc922d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.728514:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fba200 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123184.728518:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc922d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.728527:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc922d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.728541:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:3.0:1789123184.728545:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789123184.728550:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc922d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.728557:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc922d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123184.728885:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+49:10740:x1876031364452480:12345-192.168.206.30@tcp:54:lfs.0 Request processed in 708us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123184.728896:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 103 00000100:00100000:0.0:1789123184.734944:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123184.735086:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364452736 00000100:00100000:3.0:1789123184.735100:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364452736 00000100:00100000:3.0:1789123184.735170:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 28 00000100:00100000:3.0:1789123184.735182:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+49:10740:x1876031364452736:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:3.0:1789123184.736432:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+50:10740:x1876031364452736:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 1241us (1491us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1789123184.736448:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 28 00000100:00100000:1.0:1789123184.884927:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123184.885042:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364452992 00000100:00100000:2.0:1789123184.885055:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364452992 00000100:00100000:2.0:1789123184.885131:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 104 00000100:00100000:2.0:1789123184.885143:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+50:10750:x1876031364452992:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:2.0:1789123184.885176:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123184.885180:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789123184.885217:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92258 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f699 expref: 50 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.885275:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:2.0:1789123184.885281:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789123184.885300:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc922dd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f6bc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.885437:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc922e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.885453:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc922e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.885464:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc922e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123184.885477:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789123184.886024:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc922dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6bc expref: 52 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.886043:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc922e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6bc expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.886052:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:2.0:1789123184.886055:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789123184.886057:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80a600, rc 0) 00000100:00100000:2.0:1789123184.886149:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+51:10750:x1876031364452992:12345-192.168.206.30@tcp:101:bash.0 Request processed in 1007us (1236us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1789123184.886157:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 104 00000100:00100000:0.0:1789123184.891368:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123184.891552:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364453248 00000100:00100000:2.0:1789123184.891567:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364453248 00000100:00100000:2.0:1789123184.891689:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 105 00000100:00100000:2.0:1789123184.891701:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+51:10750:x1876031364453248:12345-192.168.206.30@tcp:36:bash.0 00010000:00010000:2.0:1789123184.891782:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789123184.891820:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc922e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6bc expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.891847:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbaa00/0x7e1648d68fc922c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6b5 expref: 50 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.891860:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:2.0:1789123184.891867:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789123184.892148:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc922f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.892165:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc922f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.892178:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc922f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789123184.892241:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1789123184.892287:0:5840:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000012e01ea1 reply state 00000000f629a556 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc922f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123184.892298:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789123184.892437:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+52:10750:x1876031364453248:12345-192.168.206.30@tcp:36:bash.0 Request processed in 738us (1084us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789123184.892446:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 105 00000020:00080000:2.0:1789123184.892466:0:5840:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789123184.897757:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123184.898011:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364453376 00000100:00100000:3.0:1789123184.898026:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364453376 00000100:00100000:3.0:1789123184.898124:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 106 00000100:00100000:3.0:1789123184.898137:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+52:10750:x1876031364453376:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:3.0:1789123184.898380:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123184.898419:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc922f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f6c3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.898521:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc92300 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.898534:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc922f2 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.898542:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc92300 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.898561:0:5841:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc922f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.898573:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc92300 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.899999:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc922f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.900018:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc922f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.900025:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc922f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.900033:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123184.900037:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc922f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.900046:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc922f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.900065:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:2.0:1789123184.900069:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123184.900073:0:3289:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc92300 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.900082:0:3289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc92300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.900091:0:3289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc92300 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.900138:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc922f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123184.900145:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc922f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.900677:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc92300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.900687:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc92300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123184.900749:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789123184.900755:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789123184.900799:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc92300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.900845:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc922f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6c3 expref: 53 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.900863:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc92300 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6c3 expref: 52 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123184.900872:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:3.0:1789123184.900876:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789123184.900878:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbb200, rc 0) 00000100:00100000:3.0:1789123184.900976:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+52:10750:x1876031364453376:12345-192.168.206.30@tcp:101:bash.0 Request processed in 2841us (3233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123184.900987:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 106 00000100:00100000:0.0:1789123184.914763:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123184.915082:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364453632 00000100:00100000:3.0:1789123184.915098:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364453632 00000100:00100000:3.0:1789123184.915187:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 29 00000100:00100000:3.0:1789123184.915202:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+52:10750:x1876031364453632:12345-192.168.206.30@tcp:35:bash.0 00000100:00100000:3.0:1789123184.915539:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+53:10750:x1876031364453632:12345-192.168.206.30@tcp:35:bash.0 Request processed in 340us (793us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1789123184.915549:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 29 00000100:00100000:1.0:1789123185.021721:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123185.021923:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364453760 00000100:00100000:3.0:1789123185.021936:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364453760 00000100:00100000:3.0:1789123185.022010:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 107 00000100:00100000:3.0:1789123185.022023:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+53:10756:x1876031364453760:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:3.0:1789123185.022053:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123185.022091:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc92307 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f6ca expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123185.022179:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc9230e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123185.022198:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc9230e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123185.022211:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc9230e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123185.022284:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1789123185.022288:0:7640:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789123185.022325:0:7640:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc9230e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123185.022355:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc92307 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6ca expref: 55 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123185.022375:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc9230e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6ca expref: 54 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123185.022384:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:3.0:1789123185.022388:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789123185.022392:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbb000, rc 0) 00000100:00100000:3.0:1789123185.022481:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+54:10756:x1876031364453760:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 460us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123185.022488:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 107 00000100:00100000:0.0:1789123185.032671:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123185.032819:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364453888 00000100:00100000:2.0:1789123185.032833:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364453888 00000100:00100000:2.0:1789123185.032911:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 108 00000100:00100000:2.0:1789123185.032923:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+54:10756:x1876031364453888:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1789123185.032951:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123185.032979:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92315 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f6d1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.033082:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9231c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.033101:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9231c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.033114:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9231c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.033132:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc92323 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.033139:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc92323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.033146:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc92323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.033288:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc9232a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.033309:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc9232a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.033325:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc9232a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123185.033368:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789123185.033373:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789123185.033392:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc9232a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.033415:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc9232a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.033423:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9231c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.033430:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9231c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.033436:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9231c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.033441:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123185.033445:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9231c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.033454:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9231c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.033465:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:2.0:1789123185.033469:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123185.033474:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9231c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.033489:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9231c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.033504:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc92323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.033509:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc92323 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.033515:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc92323 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.033519:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80b400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123185.033522:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc92323 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.033527:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc92323 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.033533:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f34232f7b00) 00010000:00010000:2.0:1789123185.033536:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123185.033538:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc92323 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.033544:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc92323 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.033576:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92315 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6d1 expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.033588:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc9232a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6d1 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.033601:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:2.0:1789123185.033603:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789123185.033606:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80bc00, rc 0) 00000100:00100000:2.0:1789123185.033734:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+55:10756:x1876031364453888:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 813us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123185.033743:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 108 00000100:00100000:0.0:1789123185.042376:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123185.042438:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123185.042820:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364454144 00000100:00100000:3.0:1789123185.042847:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364454144 00000100:00100000:3.0:1789123185.042926:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 109 00000100:00100000:3.0:1789123185.042938:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+55:10756:x1876031364454144:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:3.0:1789123185.042965:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123185.042992:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc92331 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f6d8 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123185.043152:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbe00/0x7e1648d68fc92338 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123185.043833:0:7640:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc92300 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6c3 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123185.043849:0:7640:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc9232a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6d1 expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123185.043857:0:7640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbe00/0x7e1648d68fc92338 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123185.043912:0:7640:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc9232a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6d1 expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123185.043928:0:7640:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc9232a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6d1 expref: 56 pid: 5842 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123185.043944:0:7640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1876031381247360:192.168.206.30@tcp:104: 00010000:00010000:3.0:1789123185.044318:0:7640:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc92300 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6c3 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123185.044342:0:7640:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc92300 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6c3 expref: 56 pid: 5841 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123185.044352:0:7640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1876031381247488:192.168.206.30@tcp:104: 00000100:00100000:3.0:1789123185.044392:0:7640:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340e0663c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123185.045694:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364454272 00000100:00100000:1.0:1789123185.045720:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364454272 00010000:00010000:1.0:1789123185.045780:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc9232a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6d1 expref: 57 pid: 5842 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123185.045827:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 57 00000100:00100000:1.0:1789123185.045838:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+57:2355:x1876031364454272:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789123185.045859:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123185.045867:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc9232a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6d1 expref: 57 pid: 5842 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123185.045883:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc9232a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6d1 expref: 57 pid: 5842 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123185.045911:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:1.0:1789123185.045917:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbe00/0x7e1648d68fc92338 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123185.045925:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbe00/0x7e1648d68fc92338 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123185.045933:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789123185.045985:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+57:2355:x1876031364454272:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 148us (3546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123185.045994:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 57 00000100:00100000:0.0:1789123185.053719:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123185.053895:0:11614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364454400 00000100:00100000:1.0:1789123185.053909:0:11614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364454400 00010000:00010000:1.0:1789123185.053968:0:11614:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc92300 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6c3 expref: 57 pid: 5841 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123185.054021:0:11614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 58 00000100:00100000:1.0:1789123185.054032:0:11614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+57:2354:x1876031364454400:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789123185.054051:0:11614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123185.054058:0:11614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc92300 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6c3 expref: 57 pid: 5841 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123185.054071:0:11614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc92300 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6c3 expref: 57 pid: 5841 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123185.054098:0:11614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:1.0:1789123185.054105:0:11614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbe00/0x7e1648d68fc92338 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123185.054115:0:11614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbe00/0x7e1648d68fc92338 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123185.054123:0:11614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbe00/0x7e1648d68fc92338 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123185.054143:0:11614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789123185.054389:0:11614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+57:2354:x1876031364454400:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 357us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123185.054406:0:11614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 58 00010000:00010000:3.0:1789123185.054521:0:7640:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.30@tcp) returned -22 from blocking AST (req@000000006c5bbf52 x1876031381247360) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc9232a lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6d1 expref: 56 pid: 5842 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123185.054537:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc9232a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6d1 expref: 56 pid: 5842 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123185.054555:0:7640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1876031381247360:192.168.206.30@tcp:104: 00010000:00010000:3.0:1789123185.054570:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc92300 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6c3 expref: 55 pid: 5841 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123185.054580:0:7640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1876031381247488:192.168.206.30@tcp:104: 00010000:00010000:3.0:1789123185.054604:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:3.0:1789123185.054611:0:7640:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbe00/0x7e1648d68fc92338 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123185.054621:0:7640:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbe00/0x7e1648d68fc92338 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123185.054668:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbe00/0x7e1648d68fc92338 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123185.054719:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789123185.054918:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc92331 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6d8 expref: 56 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123185.054935:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbe00/0x7e1648d68fc92338 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6d8 expref: 55 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123185.054942:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:3.0:1789123185.054945:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789123185.054948:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbbe00, rc 0) 00000100:00100000:3.0:1789123185.054980:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+55:10756:x1876031364454144:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 12045us (12620us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1789123185.054989:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 109 00000100:00100000:0.0:1789123185.058612:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123185.059648:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364454656 00000100:00100000:1.0:1789123185.059958:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364454656 00000100:00100000:1.0:1789123185.060408:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:1.0:1789123185.060422:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+55:10756:x1876031364454656:12345-192.168.206.30@tcp:103:lfs.0 00010000:00010000:1.0:1789123185.060442:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123185.060475:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92297 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6ae expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123185.060499:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:1.0:1789123185.060504:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789123185.060588:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+54:10756:x1876031364454656:12345-192.168.206.30@tcp:103:lfs.0 Request processed in 169us (1991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123185.060596:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:0.0:1789123185.064010:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123185.064230:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364454784 00000100:00100000:3.0:1789123185.064244:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364454784 00000100:00100000:3.0:1789123185.064442:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 110 00000100:00100000:3.0:1789123185.064457:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409c9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+54:10756:x1876031364454784:12345-192.168.206.30@tcp:58:lfs.0 00010000:00010000:3.0:1789123185.064596:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc92346 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123185.064616:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc92346 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123185.064678:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc92346 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789123185.064922:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1789123185.065049:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409c9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+54:10756:x1876031364454784:12345-192.168.206.30@tcp:58:lfs.0 Request processed in 595us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123185.065059:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 110 00000100:00100000:0.0:1789123185.075156:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123185.075325:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364454912 00000100:00100000:1.0:1789123185.075337:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364454912 00000100:00100000:1.0:1789123185.075417:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 111 00000100:00100000:1.0:1789123185.075429:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d32a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+54:10756:x1876031364454912:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1789123185.075454:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123185.075480:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc9234d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f6df expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123185.075548:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc92346 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123185.075560:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc9234d lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6df expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123185.075582:0:5840:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc92346 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123185.075609:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc9234d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6df expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123185.075648:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:1.0:1789123185.075652:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789123185.075657:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc9234d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6df expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123185.075665:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd32600, rc 0) 00000100:00100000:1.0:1789123185.075979:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d32a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+55:10756:x1876031364454912:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 551us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123185.075987:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 111 00010000:00010000:3.0:1789123185.167312:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789123185.668966:0:7674:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 299999335848ns, next at 300999333223ns, rc = 0 00000100:00100000:0.0:1789123185.669013:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d32b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381247616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789123185.669017:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c306d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd41f4a0-f4e3-41a1-856e-0c34af912023:3303:1876031381247744:0@lo:400:kworker.0 00000100:00100000:3.0:1789123185.669082:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c3061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876031381247872:0@lo:400:kworker.0 00000100:00100000:1.0:1789123185.669147:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c304f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876031381248000:0@lo:400:kworker.0 00000100:00100000:2.0:1789123185.674368:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123185.674466:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c3070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876031381248256:0@lo:400:kworker.0 00000100:00100000:2.0:1789123185.674502:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123185.674576:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381248256 00000100:00100000:2.0:1789123185.674600:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381248256 00000100:00080000:2.0:1789123185.674644:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789123185.674919:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789123185.674928:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c306580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876031381248256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123185.674984:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c306580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876031381248256:12345-0@lo:400:kworker.0 Request processed in 57us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123185.674992:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789123185.675027:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c3070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876031381248256:0@lo:400:kworker.0 00000100:00100000:2.0:1789123185.675072:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381247744 00000100:00100000:2.0:1789123185.675076:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381247744 00000100:00100000:2.0:1789123185.675107:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1789123185.675114:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3303:x1876031381247744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123185.675150:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3303:x1876031381247744:12345-0@lo:400:kworker.0 Request processed in 35us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123185.675172:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1789123185.675204:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c306d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd41f4a0-f4e3-41a1-856e-0c34af912023:3303:1876031381247744:0@lo:400:kworker.0 00000100:00100000:3.0:1789123185.675324:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123185.675355:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c3043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381248384:0@lo:400:kworker.0 00000100:00100000:3.0:1789123185.675384:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123185.675441:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381248384 00000100:00100000:3.0:1789123185.675445:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381248384 00000100:00100000:3.0:1789123185.675480:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789123185.675487:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1876031381248384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123185.675523:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1876031381248384:12345-0@lo:400:kworker.0 Request processed in 37us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123185.675529:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789123185.675558:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c3043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381248384:0@lo:400:kworker.0 00000100:00100000:0.0:1789123185.675813:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789123185.675837:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789123185.675844:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c304b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381248128:0@lo:400:kworker.0 00000100:00100000:2.0:1789123185.675849:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381247872 00000100:00100000:2.0:1789123185.675852:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381247872 00000100:00100000:0.0:1789123185.675869:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123185.675882:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789123185.675887:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381248128 00000100:00100000:2.0:1789123185.675888:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876031381247872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123185.675890:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381248128 00000100:00100000:0.0:1789123185.675914:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789123185.675920:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d3292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1876031381248128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123185.675921:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876031381247872:12345-0@lo:400:kworker.0 Request processed in 34us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123185.675927:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789123185.675963:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d3292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1876031381248128:12345-0@lo:400:kworker.0 Request processed in 43us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123185.675969:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789123185.675998:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c304b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381248128:0@lo:400:kworker.0 00000100:00100000:3.0:1789123185.676175:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381247616 00000100:00100000:3.0:1789123185.676180:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381247616 00000100:00100000:3.0:1789123185.676215:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789123185.676221:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d32a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1876031381247616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789123185.676264:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789123185.676425:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d32a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1876031381247616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 203us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123185.676431:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789123185.677170:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d32b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381247616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789123185.677218:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c3061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876031381247872:0@lo:400:kworker.0 00000100:00100000:1.0:1789123185.677710:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123185.677862:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381248000 00000100:00100000:2.0:1789123185.677868:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381248000 00000100:00100000:2.0:1789123185.677924:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789123185.677940:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876031381248000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123185.677983:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876031381248000:12345-0@lo:400:kworker.0 Request processed in 52us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123185.677990:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789123185.678216:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c304f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876031381248000:0@lo:400:kworker.0 00000100:00080000:3.0:1789123185.678273:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1789123185.925338:0:12081:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789123185.925345:0:12081:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789123185.925426:0:12081:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1789123185.925433:0:12081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789123185.925561:0:12081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d32b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12081:1876031381248512:192.168.206.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789123185.925689:0:12081:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408f1c540 going to sleep for 11 seconds 00000100:00100000:2.0:1789123185.947893:0:12081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d32b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12081:1876031381248512:192.168.206.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789123185.950914:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123185.951071:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364455040 00000100:00100000:2.0:1789123185.951079:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364455040 00000100:00100000:2.0:1789123185.951137:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 112 00000100:00100000:2.0:1789123185.951146:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d329a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+55:10757:x1876031364455040:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789123185.951198:0:5840:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789123185.951308:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d329a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+55:10757:x1876031364455040:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 Request processed in 162us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123185.951316:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 112 00000100:00100000:0.0:1789123185.956532:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123185.956848:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364455168 00000100:00100000:2.0:1789123185.956860:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364455168 00000100:00100000:2.0:1789123185.956930:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 113 00000100:00100000:2.0:1789123185.956941:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d328780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+55:10757:x1876031364455168:12345-192.168.206.30@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789123185.957042:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92354 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.957063:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92354 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.957079:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92354 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.966721:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc9235b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.966745:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc9235b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.966761:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc9235b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.966795:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc92362 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.966805:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc92362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.966830:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc92362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123185.966873:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789123185.966878:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789123185.966890:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc92362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.966901:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92354 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.966907:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92354 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.966913:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92354 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.966918:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123185.966922:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92354 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.966928:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92354 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.966939:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f3411751e00) 00010000:00010000:2.0:1789123185.966942:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123185.966946:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92354 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.966951:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92354 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.966977:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc9235b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.966983:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc9235b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.966988:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc9235b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.966993:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80b400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123185.966995:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc9235b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.967000:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc9235b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.967007:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9f34232f7b00) 00010000:00010000:2.0:1789123185.967009:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123185.967012:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc9235b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.967017:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc9235b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.967031:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc92362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.967037:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc92362 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.967043:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc92362 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.967053:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123185.967056:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc92362 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.967062:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc92362 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.967069:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:2.0:1789123185.967071:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123185.967074:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc92362 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.967079:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc92362 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123185.967591:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d328780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+55:10757:x1876031364455168:12345-192.168.206.30@tcp:34:lhsmtool_posix.0 Request processed in 10646us (11068us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123185.967603:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 113 00000100:00100000:1.0:1789123185.982280:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123185.982545:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364455424 00000100:00100000:2.0:1789123185.982556:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364455424 00000100:00100000:2.0:1789123185.982664:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 114 00000100:00100000:2.0:1789123185.982677:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+55:10757:x1876031364455424:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789123185.982713:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123185.982740:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc92369 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f6e6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.982860:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92370 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.982894:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.982908:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123185.982922:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789123185.983084:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.983094:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92370 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.983101:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92370 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.983107:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a200 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123185.983112:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92370 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.983120:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92370 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.983136:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:2.0:1789123185.983139:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789123185.983144:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92370 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.983151:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92370 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.983209:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc92369 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6e6 expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.983228:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f3411751e00) 00010000:00010000:2.0:1789123185.983230:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789123185.983235:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc92369 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6e6 expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123185.983246:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80aa00, rc 0) 00000100:00100000:2.0:1789123185.983341:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+56:10757:x1876031364455424:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 666us (1090us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1789123185.983349:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 114 00000100:00100000:0.0:1789123185.993783:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123185.998095:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364455552 00000100:00100000:1.0:1789123185.998115:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364455552 00000100:00100000:1.0:1789123185.998213:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 115 00000100:00100000:1.0:1789123185.998226:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d32bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+56:10757:x1876031364455552:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789123185.998282:0:5841:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789123185.998457:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d32bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+56:10757:x1876031364455552:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 Request processed in 233us (4686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123185.998466:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 115 00000100:00100000:1.0:1789123186.003492:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123186.012276:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364455808 00000100:00100000:2.0:1789123186.012357:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364455808 00000100:00100000:3.0:1789123186.014847:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 116 00000100:00100000:3.0:1789123186.014882:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+56:10757:x1876031364455808:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789123186.014912:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123186.014916:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789123186.014952:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc9230e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6ca expref: 56 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.014978:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:3.0:1789123186.014984:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789123186.015001:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc9237e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f6ed expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789123186.016505:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1789123186.017184:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc92385 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.017543:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc92385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.017558:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc92385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789123186.019946:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789123186.022016:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc9237e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6ed expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.022056:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc92385 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6ed expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.022068:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f3411751800) 00010000:00010000:3.0:1789123186.022071:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789123186.022094:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbb200, rc 0) 00000100:00100000:3.0:1789123186.022206:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+57:10757:x1876031364455808:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 7320us (18718us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1789123186.022217:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 116 00000100:00100000:3.0:1789123186.032318:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123186.032430:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364456064 00000100:00100000:1.0:1789123186.032443:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364456064 00000100:00100000:1.0:1789123186.032516:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 117 00000100:00100000:1.0:1789123186.032527:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+57:10757:x1876031364456064:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789123186.032598:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123186.032678:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc92385 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6ed expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123186.032700:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f3411751800) 00010000:00010000:1.0:1789123186.032722:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789123186.032751:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92393 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123186.032769:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92393 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123186.032781:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92393 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123186.032796:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc9239a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xd35fe0ff bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123186.032803:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc9239a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd35fe0ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123186.032809:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc9239a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd35fe0ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123186.032906:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92393 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123186.032932:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92393 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123186.032938:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92393 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123186.032945:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32a00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123186.032950:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92393 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123186.032958:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92393 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123186.032968:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:1.0:1789123186.032971:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123186.032976:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92393 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123186.032982:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92393 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123186.032993:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc9239a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd35fe0ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123186.032999:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc9239a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd35fe0ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123186.033005:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc9239a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd35fe0ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123186.033010:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33c00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123186.033020:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc9239a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd35fe0ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123186.033026:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc9239a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd35fe0ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123186.033034:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xd35fe0ff (ffff9f340534d200) 00010000:00010000:1.0:1789123186.033036:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123186.033039:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc9239a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd35fe0ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123186.033045:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc9239a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd35fe0ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123186.033139:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+56:10757:x1876031364456064:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 613us (834us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789123186.033147:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 117 00000100:00100000:2.0:1789123186.037015:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123186.037151:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364456192 00000100:00100000:0.0:1789123186.037162:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364456192 00000100:00100000:0.0:1789123186.037241:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 118 00000100:00100000:0.0:1789123186.037253:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c3061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+56:10757:x1876031364456192:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789123186.037279:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123186.037318:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53200/0x7e1648d68fc923a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f6f4 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.037365:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc923a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.037381:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc923a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.037404:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc923a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.037527:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53200/0x7e1648d68fc923a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6f4 expref: 58 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.037547:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc923a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6f4 expref: 57 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.037556:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f34226c1f00) 00010000:00010000:0.0:1789123186.037559:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789123186.037563:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53600, rc 0) 00000100:00100000:0.0:1789123186.038119:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c3061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+57:10757:x1876031364456192:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 866us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123186.038138:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 118 00000100:00100000:0.0:1789123186.048544:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123186.049431:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364456448 00000100:00100000:1.0:1789123186.049446:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364456448 00000100:00100000:1.0:1789123186.049525:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 119 00000100:00100000:1.0:1789123186.049536:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d32b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+57:10757:x1876031364456448:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789123186.049670:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc923af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123186.049697:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc923af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123186.049718:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc923af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789123186.050026:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:1.0:1789123186.050159:0:5841:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a4a5fb5a reply state 000000007dd11364 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc923af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123186.050170:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789123186.050681:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d32b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+59:10757:x1876031364456448:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 1144us (2147us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1789123186.050690:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 119 00010000:00010000:0.0:1789123186.052670:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc923af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.052690:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc923af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.052698:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc923af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.052715:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33c00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123186.052720:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc923af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.052731:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc923af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.052749:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f34226c1f00) 00010000:00010000:0.0:1789123186.052753:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789123186.052759:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc923af lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.052766:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc923af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123186.057502:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123186.057608:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364456576 00000100:00100000:3.0:1789123186.057620:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364456576 00000100:00100000:3.0:1789123186.057728:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 120 00000100:00100000:3.0:1789123186.057741:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d32ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+58:10757:x1876031364456576:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789123186.057773:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123186.057799:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc923b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f6fb expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.057874:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc923b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6fb expref: 59 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.057892:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc923b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6fb expref: 59 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.057916:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f34226c1f00) 00010000:00010000:3.0:1789123186.057919:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789123186.057923:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fba200, rc 0) 00000100:00100000:3.0:1789123186.058002:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d32ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+59:10757:x1876031364456576:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 264us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123186.058010:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 120 00000100:00100000:3.0:1789123186.063836:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123186.064926:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364456704 00000100:00100000:1.0:1789123186.064942:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364456704 00000100:00100000:1.0:1789123186.065053:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 37 00000100:00100000:1.0:1789123186.065066:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c239850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+8:2355:x1876031364456704:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789123186.065493:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c239850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+9:2355:x1876031364456704:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 Request processed in 429us (1671us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789123186.065502:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 37 00000100:00080000:2.0:1789123186.065814:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789123186.078032:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123186.078492:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364456960 00000100:00100000:3.0:1789123186.078519:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364456960 00000100:00100000:3.0:1789123186.078591:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 30 00000100:00100000:3.0:1789123186.078604:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c306d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+59:10757:x1876031364456960:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789123186.078987:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c306d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+60:10757:x1876031364456960:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 Request processed in 385us (971us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1789123186.078997:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 30 00000100:00100000:0.0:1789123186.083282:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123186.083458:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364457216 00000100:00100000:2.0:1789123186.083472:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364457216 00000100:00100000:2.0:1789123186.083544:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 121 00000100:00100000:2.0:1789123186.083555:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d32a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+60:10757:x1876031364457216:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789123186.083760:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d32a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+60:10757:x1876031364457216:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 205us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123186.083768:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 121 00000100:00100000:1.0:1789123186.091539:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123186.092046:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364457344 00000100:00100000:3.0:1789123186.092061:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364457344 00000100:00100000:3.0:1789123186.092145:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 122 00000100:00100000:3.0:1789123186.092159:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+60:10757:x1876031364457344:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789123186.092185:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123186.092223:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc923bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f702 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.092321:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.092339:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.092352:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123186.092416:0:7640:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789123186.092439:0:7640:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.092469:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb000/0x7e1648d68fc923bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f702 expref: 62 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.092511:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f702 expref: 61 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.092520:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f34226c1f00) 00010000:00010000:3.0:1789123186.092523:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789123186.092527:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbba00, rc 0) 00000100:00100000:3.0:1789123186.092609:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+61:10757:x1876031364457344:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 453us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123186.092617:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 122 00000100:00100000:0.0:1789123186.103009:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123186.103577:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364457472 00000100:00100000:2.0:1789123186.103591:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364457472 00000100:00100000:2.0:1789123186.103710:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 38 00000100:00100000:2.0:1789123186.103724:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d328f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+9:2352:x1876031364457472:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789123186.103772:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123186.103799:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085d0ddbb/0x7e1648d68fc923cb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f709 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789123186.103833:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3da71, blocks: 0x1 00010000:00010000:2.0:1789123186.103858:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=300s v=(0 0) 00010000:00010000:2.0:1789123186.103862:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789123186.103873:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085d0ddbb/0x7e1648d68fc923cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f709 expref: 10 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.103896:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000085d0ddbb/0x7e1648d68fc923cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f709 expref: 10 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.103912:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80b400, rc 0) 00000100:00100000:2.0:1789123186.103990:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d328f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+10:2352:x1876031364457472:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 270us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123186.103997:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 38 00000100:00100000:1.0:1789123186.121410:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123186.129719:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364457728 00000100:00100000:2.0:1789123186.129742:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364457728 00000100:00100000:2.0:1789123186.129838:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 123 00000100:00100000:2.0:1789123186.129852:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+61:10757:x1876031364457728:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789123186.130003:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+61:10757:x1876031364457728:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 154us (8618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123186.130012:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 123 00000100:00100000:1.0:1789123186.135401:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123186.135612:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364457856 00000100:00100000:3.0:1789123186.135669:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364457856 00000100:00100000:3.0:1789123186.135738:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 39 00000100:00100000:3.0:1789123186.135749:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343551a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+10:10757:x1876031364457856:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789123186.135772:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123186.135796:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e21b4474/0x7e1648d68fc923d2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f710 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.135834:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000085d0ddbb/0x7e1648d68fc923cb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f709 expref: 11 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.135844:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789123186.135849:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789123186.135855:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e21b4474/0x7e1648d68fc923d2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f710 expref: 11 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.135917:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000085d0ddbb/0x7e1648d68fc923cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f709 expref: 11 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.135932:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000085d0ddbb/0x7e1648d68fc923cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f709 expref: 11 pid: 6687 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123186.135949:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f03c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1876031381248640:192.168.206.30@tcp:104: 00000100:00100000:3.0:1789123186.136076:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340e066f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789123186.140258:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123186.140832:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364457984 00000100:00100000:2.0:1789123186.140851:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364457984 00010000:00010000:2.0:1789123186.140906:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000085d0ddbb/0x7e1648d68fc923cb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f709 expref: 12 pid: 6687 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123186.140955:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 59 00000100:00100000:2.0:1789123186.140967:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d328b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+12:2354:x1876031364457984:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789123186.140986:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123186.141016:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000085d0ddbb/0x7e1648d68fc923cb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f709 expref: 12 pid: 6687 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.141031:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000085d0ddbb/0x7e1648d68fc923cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f709 expref: 12 pid: 6687 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.141076:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789123186.141082:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789123186.141092:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e21b4474/0x7e1648d68fc923d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f710 expref: 12 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.141104:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e21b4474/0x7e1648d68fc923d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f710 expref: 12 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.141493:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e21b4474/0x7e1648d68fc923d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f710 expref: 12 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123186.141512:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c3070c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876031381248768:192.168.206.30@tcp:105: 00000100:00100000:2.0:1789123186.141612:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3303e6ca80 going to sleep for 11 seconds 00010000:00010000:3.0:1789123186.146779:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085d0ddbb/0x7e1648d68fc923cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f709 expref: 12 pid: 6687 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123186.146813:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f03c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1876031381248640:192.168.206.30@tcp:104: 00010000:00010000:3.0:1789123186.146858:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e21b4474/0x7e1648d68fc923d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f710 expref: 11 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.146877:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbb000, rc 0) 00000100:00100000:3.0:1789123186.146959:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343551a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+11:10757:x1876031364457856:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 11211us (11580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123186.146970:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 39 00000100:00100000:1.0:1789123186.161385:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123186.162478:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364458112 00000100:00100000:0.0:1789123186.162492:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364458112 00002000:00100000:0.0:1789123186.162556:0:6691:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9f3405de0780 x1876031364458112/t0(0) o4->64de9449-4320-4c9f-abcb-230edd2b11ae@192.168.206.30@tcp:452/0 lens 504/0 e 0 to 0 dl 1789123197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789123186.162567:0:6691:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9f3405de0780 with x1876031364458112 ext(0->12) 00002000:00010000:0.0:1789123186.162574:0:6691:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f3405de0780 00000100:00100000:0.0:1789123186.162613:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 2 00000100:00100000:0.0:1789123186.162672:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+11:2355:x1876031364458112:12345-192.168.206.30@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789123186.167084:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+13:2355:x1876031364458112:12345-192.168.206.30@tcp:4:lhsmtool_posix.0 Request processed in 4443us (5695us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789123186.167104:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 2 00002000:00100000:0.0:1789123186.167134:0:6691:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9f3405de0780 x1876031364458112/t4294967308(0) o4->64de9449-4320-4c9f-abcb-230edd2b11ae@192.168.206.30@tcp:452/0 lens 504/448 e 0 to 0 dl 1789123197 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789123186.167146:0:6691:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9f3405de0780 with x1876031364458112 ext(0->12) 00002000:00010000:0.0:1789123186.167154:0:6691:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f3405de0780 00000100:00100000:1.0:1789123186.171541:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123186.172261:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364458240 00000100:00100000:3.0:1789123186.172281:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364458240 00000100:00100000:3.0:1789123186.172360:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 124 00000100:00100000:3.0:1789123186.172372:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435671680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+61:10757:x1876031364458240:12345-192.168.206.30@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1789123186.175171:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c3070c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876031381248768:192.168.206.30@tcp:105: 00010000:00010000:2.0:1789123186.175204:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123186.175344:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d328b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+12:2354:x1876031364457984:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 34377us (35099us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123186.175356:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 59 00010000:00010000:0.0:1789123186.193480:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789123186.330547:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:1.0:1789123186.330582:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967386 is committed 00000020:00080000:1.0:1789123186.330592:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f3408f1c600 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1789123186.330599:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f3432cdc900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f3408f1c000 00000020:00080000:1.0:1789123186.330604:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f3432cdcf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f342d88e800 00000001:00080000:1.0:1789123186.330659:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:1.0:1789123186.330668:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:1.0:1789123186.330712:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1789123186.330744:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1789123186.330774:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f340e066cc0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1789123186.330777:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f3407c6cc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f340e0660c0 00000020:00080000:1.0:1789123186.330780:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f3407c6cd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f342d751400 00000020:00080000:2.0:1789123186.330883:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1789123186.331109:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1789123186.331347:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789123186.331370:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c3070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381248896:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789123186.331462:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123186.331536:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381248896 00000100:00100000:2.0:1789123186.331544:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381248896 00000100:00100000:2.0:1789123186.331612:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789123186.331764:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c306940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1876031381248896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789123186.331801:0:6687:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:2.0:1789123186.331849:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa3da6f, atime: 0x6aa3da70, ctime: 0x6aa3da6f, blocks: 0x1 00010000:00010000:2.0:1789123186.331858:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c71d130/0x7e1648d68fc923d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.331876:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=300s v=(0 0) 00010000:00010000:2.0:1789123186.331881:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789123186.331888:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c71d130/0x7e1648d68fc923d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.331907:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c71d130/0x7e1648d68fc923d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.331932:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c71d130/0x7e1648d68fc923d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.331940:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c71d130/0x7e1648d68fc923d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.331960:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789123186.332648:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381249024:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789123186.332702:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123186.332846:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381249024 00000100:00100000:3.0:1789123186.332856:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381249024 00000100:00100000:3.0:1789123186.332900:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789123186.332909:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34356730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1876031381249024:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789123186.332928:0:8519:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:3.0:1789123186.332947:0:8519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e92faf7/0x7e1648d68fc923e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.332967:0:8519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a2281af9/0x7e1648d68fc9219b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f66f expref: 11 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.332977:0:8519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1789123186.332981:0:8519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789123186.332986:0:8519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e92faf7/0x7e1648d68fc923e0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.333017:0:8519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a2281af9/0x7e1648d68fc9219b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f66f expref: 11 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.333031:0:8519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a2281af9/0x7e1648d68fc9219b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f66f expref: 11 pid: 8519 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123186.333043:0:8519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f1e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8519:1876031381249152:192.168.206.30@tcp:104: 00000100:00100000:3.0:1789123186.333112:0:8519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3418ba9c00 going to sleep for 11 seconds 00010000:00010000:3.0:1789123186.333501:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789123186.333509:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c71d130/0x7e1648d68fc923d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.333531:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80ba00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:3.0:1789123186.333536:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c71d130/0x7e1648d68fc923d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.333547:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c71d130/0x7e1648d68fc923d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.333567:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c71d130/0x7e1648d68fc923d9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.333575:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c71d130/0x7e1648d68fc923d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.333599:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123186.333601:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123186.333602:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789123186.333613:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789123186.338966:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c306940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1876031381248896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7333us (7492us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789123186.338984:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:1.0:1789123186.339496:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f343c3070c0/2, rc 0, transno 4294967304 00000100:00100000:1.0:1789123186.339506:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c3070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381248896:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789123186.339756:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435671680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+15:10757:x1876031364458240:12345-192.168.206.30@tcp:44:lhsmtool_posix.0 Request processed in 167382us (168226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123186.339766:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 124 00000100:00100000:0.0:1789123186.345138:0:8519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f1e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8519:1876031381249152:192.168.206.30@tcp:104: 00010000:00010000:0.0:1789123186.345197:0:8519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004e92faf7/0x7e1648d68fc923e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123186.351226:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123186.351670:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123186.353081:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364458368 00000100:00100000:2.0:1789123186.353099:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364458368 00010000:00010000:2.0:1789123186.353168:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a2281af9/0x7e1648d68fc9219b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f66f expref: 12 pid: 8519 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123186.353231:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 60 00000100:00100000:2.0:1789123186.353244:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+12:2354:x1876031364458368:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789123186.353263:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123186.353283:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a2281af9/0x7e1648d68fc9219b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f66f expref: 12 pid: 8519 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.353305:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a2281af9/0x7e1648d68fc9219b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f66f expref: 12 pid: 8519 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.353358:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2281af9/0x7e1648d68fc9219b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f66f expref: 12 pid: 8519 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.353378:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789123186.353384:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789123186.353404:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e92faf7/0x7e1648d68fc923e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.353416:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e92faf7/0x7e1648d68fc923e0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.353457:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123186.353542:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+11:2354:x1876031364458368:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 300us (2329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123186.353551:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 60 00010000:00010000:0.0:1789123186.354081:0:8519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004e92faf7/0x7e1648d68fc923e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.354102:0:8519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e92faf7/0x7e1648d68fc923e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.354114:0:8519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e92faf7/0x7e1648d68fc923e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.354122:0:8519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e92faf7/0x7e1648d68fc923e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.354142:0:8519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789123186.360778:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364458496 00000100:00100000:1.0:1789123186.360802:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364458496 00000100:00100000:1.0:1789123186.360927:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 42 00000100:00100000:1.0:1789123186.360940:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355f2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+11:2355:x1876031364458496:12345-192.168.206.30@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1789123186.361237:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789123186.361247:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e92faf7/0x7e1648d68fc923e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123186.361262:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fba800 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123186.361267:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e92faf7/0x7e1648d68fc923e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123186.361298:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e92faf7/0x7e1648d68fc923e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123186.361323:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e92faf7/0x7e1648d68fc923e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123186.361351:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e92faf7/0x7e1648d68fc923e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123186.361377:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123186.361380:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123186.361382:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789123186.361449:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f34355f03c0/2, rc 0, transno 4294967309 00000100:00100000:1.0:1789123186.361471:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381249024:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789123186.361942:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34356730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3302:x1876031381249024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 29031us (29235us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789123186.361953:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789123186.461885:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355f2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+11:2355:x1876031364458496:12345-192.168.206.30@tcp:16:lhsmtool_posix.0 Request processed in 100932us (110200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123186.461903:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 42 00000001:00080000:0.0:1789123186.462065:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1789123186.462078:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1789123186.471594:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123186.471911:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364458752 00000100:00100000:2.0:1789123186.471925:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364458752 00000100:00100000:2.0:1789123186.472001:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 125 00000100:00100000:2.0:1789123186.472013:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+15:10757:x1876031364458752:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789123186.472094:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123186.472130:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f702 expref: 15 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.472181:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f34226c1f00) 00010000:00010000:2.0:1789123186.472196:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789123186.472239:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc923e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.472255:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc923e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.472267:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc923e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789123186.473048:0:5842:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000dc86476e reply state 000000005ab4a502 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc923e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123186.473062:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789123186.474847:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+16:10757:x1876031364458752:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 2824us (3255us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1789123186.474861:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 125 00010000:00010000:2.0:1789123186.488924:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc923e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.488947:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc923e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.488954:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc923e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.488961:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80ae00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123186.488966:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc923e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.488989:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc923e7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.489008:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f34226c1f00) 00010000:00010000:2.0:1789123186.489011:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123186.489017:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc923e7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.489023:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc923e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123186.491137:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123186.491189:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364458880 00000100:00100000:2.0:1789123186.491202:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364458880 00000100:00100000:2.0:1789123186.491275:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 43 00000100:00100000:2.0:1789123186.491287:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2355:x1876031364458880:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789123186.491611:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789123186.491615:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789123184 00002000:00010000:2.0:1789123186.491617:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789123184 00002000:00010000:2.0:1789123186.491656:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789123185 -> 1789123184 00002000:00010000:2.0:1789123186.491659:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789123186.491834:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2355:x1876031364458880:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 Request processed in 548us (708us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789123186.491844:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 43 00000100:00100000:1.0:1789123186.498015:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123186.498331:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364459136 00000100:00100000:3.0:1789123186.498343:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364459136 00000100:00100000:3.0:1789123186.498426:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 126 00000100:00100000:3.0:1789123186.498438:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+15:10757:x1876031364459136:12345-192.168.206.30@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789123186.498528:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.498566:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc923a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6f4 expref: 15 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.498577:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923ee lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.498791:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc923a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6f4 expref: 15 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.498810:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc923a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6f4 expref: 15 pid: 7640 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123186.498838:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876031381249280:192.168.206.30@tcp:104: 00000100:00100000:3.0:1789123186.499011:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34079030c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123186.515371:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123186.515448:0:11614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364459264 00000100:00100000:2.0:1789123186.515460:0:11614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364459264 00010000:00010000:2.0:1789123186.515512:0:11614:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc923a8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6f4 expref: 16 pid: 7640 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123186.515581:0:11614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 61 00000100:00100000:2.0:1789123186.515593:0:11614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3406286050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+16:2355:x1876031364459264:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789123186.515612:0:11614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123186.515672:0:11614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc923a8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6f4 expref: 16 pid: 7640 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.515690:0:11614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc923a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6f4 expref: 16 pid: 7640 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.515719:0:11614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f34226c1f00) 00010000:00010000:2.0:1789123186.515725:0:11614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.515736:0:11614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.515744:0:11614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923ee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.515768:0:11614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123186.515834:0:11614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3406286050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+16:2355:x1876031364459264:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 242us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123186.515842:0:11614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 61 00010000:00010000:3.0:1789123186.516914:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc923a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6f4 expref: 15 pid: 7640 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123186.516937:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876031381249280:192.168.206.30@tcp:104: 00010000:00010000:3.0:1789123186.516964:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.516975:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.516981:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.517017:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.517037:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.517045:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.517052:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbba00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123186.517057:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.517065:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.517078:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f34226c1f00) 00010000:00010000:3.0:1789123186.517082:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789123186.517086:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.517093:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123186.517174:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+14:10757:x1876031364459136:12345-192.168.206.30@tcp:55:lhsmtool_posix.0 Request processed in 18737us (19172us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789123186.517183:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 126 00000100:00100000:1.0:1789123186.538496:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123186.538700:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364459392 00000100:00100000:0.0:1789123186.538712:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364459392 00000100:00100000:0.0:1789123186.538789:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 44 00000100:00100000:0.0:1789123186.538801:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2352:x1876031364459392:12345-192.168.206.30@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789123186.538862:0:8519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b7a8270a/0x7e1648d68fc923f5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.538886:0:8519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e21b4474/0x7e1648d68fc923d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f710 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.538915:0:8519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123186.538920:0:8519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789123186.538925:0:8519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7a8270a/0x7e1648d68fc923f5 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.538971:0:8519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e21b4474/0x7e1648d68fc923d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f710 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.538986:0:8519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e21b4474/0x7e1648d68fc923d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f710 expref: 7 pid: 6686 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123186.539003:0:8519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d329680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8519:1876031381249408:192.168.206.30@tcp:104: 00000100:00100000:0.0:1789123186.539108:0:8519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3435910b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789123186.544203:0:8519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d329680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8519:1876031381249408:192.168.206.30@tcp:104: 00010000:00010000:0.0:1789123186.544253:0:8519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b7a8270a/0x7e1648d68fc923f5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123186.548491:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123186.548604:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364459520 00000100:00100000:2.0:1789123186.548617:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364459520 00010000:00010000:2.0:1789123186.548723:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e21b4474/0x7e1648d68fc923d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f710 expref: 8 pid: 6686 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123186.548790:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 62 00000100:00100000:2.0:1789123186.548801:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+8:2354:x1876031364459520:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789123186.548821:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123186.548851:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e21b4474/0x7e1648d68fc923d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f710 expref: 8 pid: 6686 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.548868:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e21b4474/0x7e1648d68fc923d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f710 expref: 8 pid: 6686 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.548897:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e21b4474/0x7e1648d68fc923d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f710 expref: 8 pid: 6686 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.548917:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789123186.548922:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789123186.548929:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b7a8270a/0x7e1648d68fc923f5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.548940:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7a8270a/0x7e1648d68fc923f5 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.548969:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123186.549040:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2354:x1876031364459520:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 239us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123186.549050:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 62 00010000:00010000:0.0:1789123186.549429:0:8519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b7a8270a/0x7e1648d68fc923f5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.549440:0:8519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7a8270a/0x7e1648d68fc923f5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.549472:0:8519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b7a8270a/0x7e1648d68fc923f5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.549487:0:8519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7a8270a/0x7e1648d68fc923f5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.549495:0:8519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7a8270a/0x7e1648d68fc923f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.549503:0:8519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53000 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:0.0:1789123186.549508:0:8519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7a8270a/0x7e1648d68fc923f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.549517:0:8519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7a8270a/0x7e1648d68fc923f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.549530:0:8519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7a8270a/0x7e1648d68fc923f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.549538:0:8519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7a8270a/0x7e1648d68fc923f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123186.549600:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2352:x1876031364459392:12345-192.168.206.30@tcp:1:lhsmtool_posix.0 Request processed in 10801us (11117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123186.549609:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 44 00000100:00100000:2.0:1789123186.555517:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123186.557345:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364459776 00000100:00100000:3.0:1789123186.557363:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364459776 00000100:00100000:3.0:1789123186.557463:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 127 00000100:00100000:3.0:1789123186.557475:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c304780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+14:10757:x1876031364459776:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789123186.557581:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.557616:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.557800:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.558080:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba800/0x7e1648d68fc92403 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.558093:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc923b6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6fb expref: 15 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.558101:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba800/0x7e1648d68fc92403 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.562560:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc923b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6fb expref: 15 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.562591:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc923b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6fb expref: 15 pid: 7640 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123186.562612:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876031381249536:192.168.206.30@tcp:104: 00000100:00100000:3.0:1789123186.562751:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34079030c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123186.576763:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123186.576972:0:11614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364459904 00000100:00100000:2.0:1789123186.576985:0:11614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364459904 00010000:00010000:2.0:1789123186.577037:0:11614:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc923b6 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6fb expref: 16 pid: 7640 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123186.577095:0:11614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 63 00000100:00100000:2.0:1789123186.577106:0:11614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+16:2354:x1876031364459904:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789123186.577124:0:11614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123186.577131:0:11614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc923b6 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6fb expref: 16 pid: 7640 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.577145:0:11614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc923b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6fb expref: 16 pid: 7640 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.577174:0:11614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f34226c1f00) 00010000:00010000:2.0:1789123186.577180:0:11614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba800/0x7e1648d68fc92403 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.577199:0:11614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba800/0x7e1648d68fc92403 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.577207:0:11614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba800/0x7e1648d68fc92403 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.577229:0:11614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123186.577311:0:11614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+16:2354:x1876031364459904:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 207us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123186.577318:0:11614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 63 00010000:00010000:3.0:1789123186.578752:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc923b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6fb expref: 15 pid: 7640 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123186.578775:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876031381249536:192.168.206.30@tcp:104: 00010000:00010000:3.0:1789123186.578805:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba800/0x7e1648d68fc92403 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.578825:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba800/0x7e1648d68fc92403 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.578832:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba800/0x7e1648d68fc92403 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789123186.579072:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1789123186.581478:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1789123186.581604:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1789123186.582077:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d329680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1876031381249664:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789123186.582806:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123186.582850:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3435910cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123186.583039:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381249664 00000100:00100000:1.0:1789123186.583049:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381249664 00000100:00100000:0.0:1789123186.583517:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789123186.583530:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d3283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1876031381249664:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789123186.584179:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d3283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1876031381249664:12345-0@lo:1000:mdt00_002.0 Request processed in 650us (1993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123186.584200:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789123186.593862:0:5842:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1789123186.593878:0:5842:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:2.0:1789123186.593904:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f34355f03c0, transno 4294967309 00000100:00100000:2.0:1789123186.593924:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d329680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1876031381249664:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1789123186.597986:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1789123186.598121:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c304000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1876031381249792:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789123186.598923:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123186.598980:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3303e6cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789123186.599499:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381249792 00000100:00100000:1.0:1789123186.599510:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381249792 00000100:00100000:1.0:1789123186.599579:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789123186.599591:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1876031381249792:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789123186.599932:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5842:x1876031381249792:12345-0@lo:1000:mdt00_002.0 Request processed in 343us (1010us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789123186.599941:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789123186.600586:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c304000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1876031381249792:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1789123186.600670:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba800/0x7e1648d68fc92403 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.600683:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba800/0x7e1648d68fc92403 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.600693:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba800/0x7e1648d68fc92403 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.600711:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fba800 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123186.600716:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba800/0x7e1648d68fc92403 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.600725:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba800/0x7e1648d68fc92403 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.600743:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f34226c1f00) 00010000:00010000:2.0:1789123186.600747:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789123186.600753:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba800/0x7e1648d68fc92403 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.600778:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba800/0x7e1648d68fc92403 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.600820:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc92346 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.600828:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc92346 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.600834:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc92346 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.600840:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fba600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123186.600844:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc92346 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.600851:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc92346 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.600860:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:2.0:1789123186.600863:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789123186.600872:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc9234d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6df expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.600884:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc9234d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6df expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.600894:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc9234d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6df expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.600945:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc9234d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6df expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123186.600961:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c304f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876031381249920:192.168.206.30@tcp:105: 00000100:00100000:2.0:1789123186.601058:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3303e6cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789123186.607082:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c304f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876031381249920:192.168.206.30@tcp:105: 00010000:00010000:2.0:1789123186.607127:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc92346 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.607140:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc92346 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.607180:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc9240a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.607208:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc9240a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.607224:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc9240a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.607236:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc9240a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.607242:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc9240a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.607259:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc9240a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.607299:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80b600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123186.607304:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc9240a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.607312:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc9240a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.607327:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:2.0:1789123186.607330:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123186.607334:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc9240a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.607340:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc9240a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.607350:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.607355:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.607360:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.607365:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbba00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123186.607367:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.607373:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923fc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.607402:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:2.0:1789123186.607405:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789123186.607408:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923fc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.607414:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc923fc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123186.608144:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c304780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+18:10757:x1876031364459776:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 50665us (52635us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1789123186.608159:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 127 00000020:00080000:3.0:1789123186.608167:0:5842:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789123186.608435:0:12081:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789123186.608441:0:12081:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789123186.608974:0:12081:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789123186.608983:0:12081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789123186.612739:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123186.612879:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364460032 00000100:00100000:3.0:1789123186.612891:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364460032 00000100:00100000:3.0:1789123186.612958:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 31 00000100:00100000:3.0:1789123186.612969:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+18:10756:x1876031364460032:12345-192.168.206.30@tcp:49:lfs.0 00000100:00100000:3.0:1789123186.613140:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+18:10756:x1876031364460032:12345-192.168.206.30@tcp:49:lfs.0 Request processed in 171us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123186.613148:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 31 00000100:00100000:2.0:1789123186.618869:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123186.618966:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364460288 00000100:00100000:3.0:1789123186.618980:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364460288 00000100:00100000:3.0:1789123186.619054:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 32 00000100:00100000:3.0:1789123186.619077:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427abe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+18:10757:x1876031364460288:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789123186.619964:0:5844:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789123186.620082:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1789123186.620135:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc92411 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.620167:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc92411 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.620181:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc92411 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.620191:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc92411 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.620198:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc92411 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.620205:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc92411 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123186.620225:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789123186.620352:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427abe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+20:10757:x1876031364460288:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 Request processed in 1286us (1494us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1789123186.620362:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 32 00000020:00080000:3.0:1789123186.620369:0:5844:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789123186.621525:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789123186.621537:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc92411 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.621548:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fba200 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:0.0:1789123186.621553:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc92411 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.621562:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc92411 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.621580:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f3411751a00) 00010000:00010000:0.0:1789123186.621584:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789123186.621589:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc92411 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.621596:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba200/0x7e1648d68fc92411 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.621674:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123186.621676:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123186.621678:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123186.625378:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123186.625491:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364460544 00000100:00100000:0.0:1789123186.625504:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364460544 00000100:00100000:0.0:1789123186.625572:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 128 00000100:00100000:0.0:1789123186.625584:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+20:10756:x1876031364460544:12345-192.168.206.30@tcp:58:lfs.0 00000040:00080000:0.0:1789123186.625989:0:7640:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1789123186.626106:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+20:10756:x1876031364460544:12345-192.168.206.30@tcp:58:lfs.0 Request processed in 523us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123186.626115:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 128 00000100:00100000:1.0:1789123186.671779:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123186.671949:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364460672 00000100:00100000:2.0:1789123186.671960:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364460672 00000100:00100000:2.0:1789123186.672024:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 129 00000100:00100000:2.0:1789123186.672036:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+20:10759:x1876031364460672:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1789123186.672075:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123186.672102:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc92418 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f717 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.672184:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9241f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.672211:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9241f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.672609:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9241f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.672671:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92426 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.672681:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92426 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.672715:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92426 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.673055:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc9242d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.673980:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbe00/0x7e1648d68fc92338 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6d8 expref: 21 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.673995:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc9242d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.676160:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbe00/0x7e1648d68fc92338 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6d8 expref: 21 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.676195:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbe00/0x7e1648d68fc92338 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6d8 expref: 21 pid: 7640 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123186.676216:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d329e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876031381250048:192.168.206.30@tcp:104: 00000100:00100000:0.0:1789123186.676974:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3435910780 going to sleep for 11 seconds 00000100:00100000:2.0:1789123186.685046:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123186.685141:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364460928 00000100:00100000:3.0:1789123186.685153:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364460928 00000100:00100000:3.0:1789123186.685230:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 33 00000100:00100000:3.0:1789123186.685242:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c304f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+22:6051:x1876031364460928:12345-192.168.206.30@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789123186.685590:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c304f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+23:6051:x1876031364460928:12345-192.168.206.30@tcp:35:ldlm_bl.0 Request processed in 350us (559us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1789123186.685599:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 33 00000100:00100000:1.0:1789123186.689161:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123186.689428:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364461056 00000100:00100000:2.0:1789123186.689450:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364461056 00010000:00010000:2.0:1789123186.689511:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbe00/0x7e1648d68fc92338 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6d8 expref: 23 pid: 7640 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123186.689560:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 64 00000100:00100000:2.0:1789123186.689572:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+23:2355:x1876031364461056:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789123186.689589:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123186.689597:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbe00/0x7e1648d68fc92338 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6d8 expref: 23 pid: 7640 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.689612:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbe00/0x7e1648d68fc92338 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6d8 expref: 23 pid: 7640 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.689688:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:2.0:1789123186.689861:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc9242d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.689873:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc9242d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.689881:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc9242d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123186.689906:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123186.689967:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+23:2355:x1876031364461056:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 398us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123186.689975:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 64 00010000:00010000:0.0:1789123186.693174:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbe00/0x7e1648d68fc92338 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6d8 expref: 22 pid: 7640 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123186.693219:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d329e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876031381250048:192.168.206.30@tcp:104: 00010000:00010000:0.0:1789123186.693255:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc9242d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.693294:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc9242d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.693300:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc9242d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123186.693356:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789123186.693362:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789123186.693385:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc9242d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.693414:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc9242d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.693425:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9241f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.693433:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9241f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.693448:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9241f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.693455:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123186.693459:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9241f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.693468:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9241f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.694159:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:0.0:1789123186.694172:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123186.694179:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9241f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.694199:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9241f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.694216:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92426 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.694223:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92426 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.694231:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92426 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.694237:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a200 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123186.694241:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92426 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.694257:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92426 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.694266:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f34232f7d00) 00010000:00010000:0.0:1789123186.694269:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123186.694272:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92426 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.694277:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92426 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.694340:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc92418 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f717 expref: 22 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.694371:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc9242d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f717 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123186.694379:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:0.0:1789123186.694381:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789123186.694384:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80aa00, rc 0) 00000100:00100000:1.0:1789123186.696782:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+21:10759:x1876031364460672:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 24734us (25005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123186.696798:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 129 00010000:00010000:1.0:1789123187.207830:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123187.208280:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789123187.208300:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381250176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789123187.208372:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123187.208536:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381250176 00000100:00100000:0.0:1789123187.208543:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381250176 00000100:00100000:0.0:1789123187.209190:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789123187.209202:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f341848b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1876031381250176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789123187.209234:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789123187.209281:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f341848b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1876031381250176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123187.209287:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789123187.210239:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381250176:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789123187.655297:0:12081:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789123187.655311:0:12081:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789123187.655397:0:12081:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789123187.655408:0:12081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789123187.655565:0:12081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3407d3cf00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12081:1876031381250304:192.168.206.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789123187.655716:0:12081:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3403967540 going to sleep for 11 seconds 00000100:00100000:3.0:1789123187.664705:0:12081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3407d3cf00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12081:1876031381250304:192.168.206.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789123187.665141:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123187.665182:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364461184 00000100:00100000:1.0:1789123187.665190:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364461184 00000100:00100000:1.0:1789123187.665249:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 130 00000100:00100000:1.0:1789123187.665260:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+21:10770:x1876031364461184:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789123187.665308:0:7640:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789123187.665443:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+21:10770:x1876031364461184:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 Request processed in 184us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123187.665450:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 130 00000100:00100000:2.0:1789123187.691371:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123187.691676:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364461440 00000100:00100000:0.0:1789123187.691704:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364461440 00000100:00100000:0.0:1789123187.691767:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 131 00000100:00100000:0.0:1789123187.691780:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c304b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+21:10770:x1876031364461440:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789123187.691807:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123187.691834:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53200/0x7e1648d68fc92434 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f71e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123187.691977:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc9243b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123187.691994:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc9243b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123187.692019:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc9243b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123187.692035:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789123187.692191:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53200/0x7e1648d68fc92434 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f71e expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123187.692207:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc9243b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f71e expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123187.692217:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:0.0:1789123187.692220:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789123187.692224:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53c00, rc 0) 00000100:00100000:0.0:1789123187.692658:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c304b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+23:10770:x1876031364461440:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 879us (1300us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1789123187.692666:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 131 00000100:00100000:1.0:1789123187.705422:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123187.707129:0:11614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364461568 00000100:00100000:2.0:1789123187.707144:0:11614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364461568 00000100:00100000:2.0:1789123187.707225:0:11614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 8 00000100:00100000:2.0:1789123187.707238:0:11614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407d3f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+23:2352:x1876031364461568:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789123187.707260:0:11614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123187.707303:0:11614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc9243b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f71e expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123187.707325:0:11614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:2.0:1789123187.707332:0:11614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123187.707429:0:11614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407d3f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+22:2352:x1876031364461568:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 194us (2020us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123187.707438:0:11614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 8 00000100:00100000:2.0:1789123187.728230:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123187.728648:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364461824 00000100:00100000:1.0:1789123187.728661:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364461824 00000100:00100000:1.0:1789123187.728762:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 132 00000100:00100000:1.0:1789123187.728774:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c3043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+22:10770:x1876031364461824:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789123187.728888:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92449 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123187.728917:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92449 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123187.728934:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92449 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123187.729179:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92449 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123187.729189:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92449 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123187.729197:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92449 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123187.729204:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32c00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123187.729208:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92449 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123187.729217:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92449 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123187.729232:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:1.0:1789123187.729236:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789123187.729241:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92449 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123187.729259:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92449 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123187.730528:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c3043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+23:10770:x1876031364461824:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 1746us (2302us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1789123187.730541:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 132 00000040:00080000:2.0:1789123187.730923:0:12081:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789123187.730936:0:12081:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789123187.731848:0:12081:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789123187.731954:0:12081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789123187.758570:0:12451:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789123187.758580:0:12451:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789123187.758793:0:12451:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789123187.758800:0:12451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789123187.761137:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123187.761185:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364462080 00000100:00100000:1.0:1789123187.761197:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364462080 00000100:00100000:1.0:1789123187.761265:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 34 00000100:00100000:1.0:1789123187.761279:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407d3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+23:10770:x1876031364462080:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789123187.761566:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407d3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+24:10770:x1876031364462080:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 Request processed in 290us (442us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1789123187.761573:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 34 00000100:00100000:1.0:1789123188.003757:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123188.004070:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364462336 00000100:00100000:0.0:1789123188.004084:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364462336 00000100:00100000:0.0:1789123188.004186:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 133 00000100:00100000:0.0:1789123188.004199:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f341848bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+24:10783:x1876031364462336:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:0.0:1789123188.004230:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123188.004258:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc92450 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f725 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789123188.004943:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789123188.005120:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52200/0x7e1648d68fc92457 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123188.005159:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52200/0x7e1648d68fc92457 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123188.005174:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52200/0x7e1648d68fc92457 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123188.005189:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789123188.005349:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc92450 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f725 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123188.005367:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52200/0x7e1648d68fc92457 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f725 expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123188.005376:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:0.0:1789123188.005379:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789123188.005396:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b52200, rc 0) 00000100:00100000:0.0:1789123188.006440:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f341848bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+26:10783:x1876031364462336:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 2231us (2684us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1789123188.006453:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 133 00000100:00100000:2.0:1789123188.023462:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123188.023677:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364462464 00000100:00100000:1.0:1789123188.023688:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364462464 00000100:00100000:1.0:1789123188.023749:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 134 00000100:00100000:1.0:1789123188.023760:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c306d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+26:10783:x1876031364462464:12345-192.168.206.30@tcp:54:lfs.0 00010000:00010000:1.0:1789123188.023844:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc92465 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123188.023867:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc92465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123188.023881:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc92465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123188.023937:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc92465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123188.023944:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc92465 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123188.023951:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc92465 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123188.023957:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33200 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123188.023961:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc92465 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123188.023970:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc92465 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123188.023984:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:1.0:1789123188.023987:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789123188.023992:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc92465 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123188.023999:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33200/0x7e1648d68fc92465 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123188.024083:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c306d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+26:10783:x1876031364462464:12345-192.168.206.30@tcp:54:lfs.0 Request processed in 324us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123188.024091:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 134 00000100:00100000:3.0:1789123188.141245:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123188.141397:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364462592 00000100:00100000:1.0:1789123188.141410:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364462592 00000100:00100000:1.0:1789123188.141515:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 45 00000100:00100000:1.0:1789123188.141542:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2355:x1876031364462592:12345-192.168.206.30@tcp:101:cat.0 00010000:00010000:1.0:1789123188.141566:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123188.141822:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009128a704/0x7e1648d68fc9246c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f72c expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789123188.141865:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa3da70, atime: 0x6aa3da70, ctime: 0x6aa3da70, blocks: 0xb 00010000:00010000:1.0:1789123188.141895:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=302s v=(0 0) 00010000:00010000:1.0:1789123188.141900:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123188.141924:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009128a704/0x7e1648d68fc9246c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f72c expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123188.141951:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009128a704/0x7e1648d68fc9246c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f72c expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123188.141970:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd33200, rc 0) 00000100:00100000:1.0:1789123188.142050:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2355:x1876031364462592:12345-192.168.206.30@tcp:101:cat.0 Request processed in 513us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123188.142057:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 45 00000100:00080000:3.0:1789123188.143239:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789123188.175214:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123188.175263:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364462720 00000100:00100000:1.0:1789123188.175275:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364462720 00002000:00100000:1.0:1789123188.175335:0:6692:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9f34184c8f00 x1876031364462720/t0(0) o3->64de9449-4320-4c9f-abcb-230edd2b11ae@192.168.206.30@tcp:454/0 lens 488/0 e 0 to 0 dl 1789123199 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789123188.175347:0:6692:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9f34184c8f00 with x1876031364462720 ext(0->4095) 00002000:00010000:1.0:1789123188.175354:0:6692:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f34184c8f00 00000100:00100000:1.0:1789123188.175400:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 3 00000100:00100000:1.0:1789123188.175418:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2354:x1876031364462720:12345-192.168.206.30@tcp:3:cat.0 00000100:00100000:1.0:1789123188.179898:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184c8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2354:x1876031364462720:12345-192.168.206.30@tcp:3:cat.0 Request processed in 4473us (4689us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789123188.179913:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 3 00002000:00100000:1.0:1789123188.179924:0:6692:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9f34184c8f00 x1876031364462720/t0(0) o3->64de9449-4320-4c9f-abcb-230edd2b11ae@192.168.206.30@tcp:454/0 lens 488/4536 e 0 to 0 dl 1789123199 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789123188.179934:0:6692:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9f34184c8f00 with x1876031364462720 ext(0->4095) 00002000:00010000:1.0:1789123188.179941:0:6692:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f34184c8f00 00010000:00010000:0.0:1789123188.228796:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123188.650136:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123188.650182:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123188.650213:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123188.650245:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123188.650268:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123188.650418:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364463360 00000100:00100000:0.0:1789123188.650435:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364463360 00000100:00100000:0.0:1789123188.650508:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364462976 00000100:00100000:0.0:1789123188.650512:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364462976 00000100:00100000:0.0:1789123188.650547:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 144 00000100:00100000:0.0:1789123188.650558:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d768780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2352:x1876031364463360:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123188.650658:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d768780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2352:x1876031364463360:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 101us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123188.650680:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 144 00000100:00100000:0.0:1789123188.650696:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 145 00000100:00100000:0.0:1789123188.650702:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+26:2352:x1876031364462976:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123188.650726:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+26:2352:x1876031364462976:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 25us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123188.650732:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 145 00000100:00100000:0.0:1789123188.650752:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364463104 00000100:00100000:0.0:1789123188.650756:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364463104 00000100:00100000:0.0:1789123188.650776:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364463232 00000100:00100000:0.0:1789123188.650779:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364463232 00000100:00100000:0.0:1789123188.650795:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 70 00000100:00100000:0.0:1789123188.650801:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d76a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2352:x1876031364463104:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123188.650824:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d76a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2352:x1876031364463104:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 23us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123188.650830:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 70 00000100:00100000:0.0:1789123188.650841:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 71 00000100:00100000:0.0:1789123188.650846:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2352:x1876031364463232:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123188.650865:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2352:x1876031364463232:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 20us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123188.650870:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 71 00000100:00100000:2.0:1789123188.651148:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364462848 00000100:00100000:2.0:1789123188.651153:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364462848 00000100:00100000:2.0:1789123188.651189:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 315 00000100:00100000:2.0:1789123188.651196:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+13:2352:x1876031364462848:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1789123188.651226:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+13:2352:x1876031364462848:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 31us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123188.651232:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 315 00000100:00080000:1.0:1789123188.652036:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789123188.652042:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789123189.257205:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789123189.325746:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1789123189.325764:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1789123189.325770:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:0.0:1789123190.277226:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789123190.790678:0:7674:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 305121047417ns, next at 306121045241ns, rc = 0 00000100:00100000:0.0:1789123190.790715:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381250432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789123190.790801:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123190.790966:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381250688:0@lo:400:kworker.0 00000100:00100000:3.0:1789123190.790998:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123190.798309:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789123190.798327:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381250560:0@lo:400:kworker.0 00000100:00100000:0.0:1789123190.798411:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123190.798502:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381250432 00000100:00100000:0.0:1789123190.798514:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381250432 00000100:00100000:0.0:1789123190.798574:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789123190.798583:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d329680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876031381250432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789123190.798619:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789123190.798681:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d329680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876031381250432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (7880us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123190.798689:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789123190.798714:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381250688 00000100:00100000:0.0:1789123190.798718:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381250688 00000100:00100000:0.0:1789123190.798747:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789123190.798754:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381250688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123190.798788:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381250688:12345-0@lo:400:kworker.0 Request processed in 35us (7789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123190.798795:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789123190.798813:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381250560 00000100:00100000:0.0:1789123190.798816:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381250560 00000100:00100000:0.0:1789123190.798839:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1789123190.798846:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3304:x1876031381250560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123190.798877:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3304:x1876031381250560:12345-0@lo:400:kworker.0 Request processed in 31us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123190.798883:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1789123190.798946:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381250560:0@lo:400:kworker.0 00000100:00100000:0.0:1789123190.798990:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381250432:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789123190.799036:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789123190.799245:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381250688:0@lo:400:kworker.0 00000100:00100000:3.0:1789123190.799310:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789123190.799317:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381250816:0@lo:400:kworker.0 00000100:00100000:3.0:1789123190.799348:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123190.800533:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381250816 00000100:00100000:0.0:1789123190.800542:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381250816 00000100:00100000:0.0:1789123190.800611:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789123190.800622:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381250816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123190.800719:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381250816:12345-0@lo:400:kworker.0 Request processed in 100us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123190.800726:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789123190.800756:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381251072:0@lo:400:kworker.0 00000100:00100000:0.0:1789123190.800786:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123190.800809:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789123190.800815:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381250944:0@lo:400:kworker.0 00000100:00100000:0.0:1789123190.800840:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123190.800865:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381250944 00000100:00100000:0.0:1789123190.800869:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381250944 00000100:00100000:0.0:1789123190.800898:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789123190.800905:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d328b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381250944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123190.801178:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d328b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381250944:12345-0@lo:400:kworker.0 Request processed in 273us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123190.801185:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789123190.801206:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381251072 00000100:00100000:0.0:1789123190.801209:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381251072 00000100:00100000:0.0:1789123190.801233:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789123190.801239:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876031381251072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123190.801269:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876031381251072:12345-0@lo:400:kworker.0 Request processed in 30us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123190.801290:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789123190.801322:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1789123190.801327:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1789123190.801342:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f343c3070c0, transno 4294967304 00000100:00100000:0.0:1789123190.801354:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381250944:0@lo:400:kworker.0 00000100:00100000:0.0:1789123190.801377:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381251072:0@lo:400:kworker.0 00000100:00100000:0.0:1789123190.801672:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381250816:0@lo:400:kworker.0 00000100:00080000:2.0:1789123190.801758:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789123190.801763:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789123191.309390:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789123191.485172:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:3.0:1789123191.485188:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1789123191.485214:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f3303e6c840 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1789123191.485219:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f3301a16500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f3303e6c780 00000020:00080000:3.0:1789123191.485223:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f3301a16700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f330130a400 00000020:00080000:3.0:1789123191.485233:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1789123191.485309:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1789123191.485470:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:3.0:1789123191.487767:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381251200:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789123191.487839:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123191.488073:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381251200 00000100:00100000:1.0:1789123191.488082:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381251200 00000100:00100000:1.0:1789123191.488138:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789123191.488148:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1876031381251200:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789123191.488343:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789123191.488347:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789123184 -> 1789123184 00002000:00010000:1.0:1789123191.488350:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1789123184 -> 1789123184 00002000:00010000:1.0:1789123191.488352:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789123184 -> 1789123184 00002000:00010000:1.0:1789123191.488354:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789123191.488400:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3302:x1876031381251200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 253us (561us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789123191.488418:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:3.0:1789123191.488618:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f34355f1e00/2, rc 0, transno 4294967312 00000100:00100000:3.0:1789123191.488656:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381251200:0@lo:2:osp-syn-1-0.0 00000001:00080000:3.0:1789123191.909992:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:3.0:1789123191.910011:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:0.0:1789123192.324833:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123192.325966:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789123192.325985:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d32b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381251328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789123192.326059:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123192.326218:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381251328 00000100:00100000:0.0:1789123192.326225:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381251328 00000100:00100000:0.0:1789123192.326286:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789123192.326295:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381251328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789123192.326339:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789123192.326396:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381251328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123192.326413:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789123192.326461:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d32b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381251328:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789123192.326684:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1789123192.837870:0:12081:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789123192.837879:0:12081:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789123192.837918:0:12081:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789123192.837925:0:12081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789123193.362120:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123193.771902:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123193.776522:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123193.776569:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123193.776596:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123193.776736:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123193.776777:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364463616 00000100:00100000:1.0:1789123193.776789:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364463616 00000100:00100000:1.0:1789123193.776861:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364464000 00000100:00100000:1.0:1789123193.776865:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364464000 00000100:00100000:1.0:1789123193.776896:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 149 00000100:00100000:1.0:1789123193.776908:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+13:2352:x1876031364463616:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123193.777004:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+13:2352:x1876031364463616:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 99us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123193.777013:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 149 00000100:00100000:1.0:1789123193.777034:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 150 00000100:00100000:1.0:1789123193.777040:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2354:x1876031364464000:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123193.777066:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2354:x1876031364464000:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 26us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123193.777073:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 150 00000100:00100000:1.0:1789123193.777093:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364463744 00000100:00100000:1.0:1789123193.777097:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364463744 00000100:00100000:1.0:1789123193.777122:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364463872 00000100:00100000:1.0:1789123193.777125:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364463872 00000100:00100000:1.0:1789123193.777146:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 73 00000100:00100000:1.0:1789123193.777152:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2353:x1876031364463744:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123193.777178:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2353:x1876031364463744:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 27us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123193.777196:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 73 00000100:00100000:1.0:1789123193.777209:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 74 00000100:00100000:1.0:1789123193.777215:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2354:x1876031364463872:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123193.777238:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2354:x1876031364463872:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 24us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123193.778785:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 74 00000100:00080000:1.0:1789123193.778847:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789123193.778854:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789123193.778858:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789123193.781388:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364463488 00000100:00100000:0.0:1789123193.781405:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364463488 00000100:00100000:0.0:1789123193.781481:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 317 00000100:00100000:0.0:1789123193.781492:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+13:2353:x1876031364463488:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123193.781586:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+13:2353:x1876031364463488:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 96us (9698us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123193.781611:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 317 00010000:00010000:0.0:1789123194.373662:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123194.908506:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123194.908830:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364464128 00000100:00100000:0.0:1789123194.908850:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364464128 00000100:00100000:0.0:1789123194.908910:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 135 00000100:00100000:0.0:1789123194.908920:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+13:10444:x1876031364464128:12345-192.168.206.30@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789123194.909317:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+13:10444:x1876031364464128:12345-192.168.206.30@tcp:60:lhsmtool_posix.0 Request processed in 396us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123194.909327:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 135 00000100:00100000:2.0:1789123194.913331:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123194.914432:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364464384 00000100:00100000:3.0:1789123194.914447:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364464384 00000100:00100000:2.0:1789123194.914940:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 35 00000100:00100000:2.0:1789123194.914968:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c3070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+13:10444:x1876031364464384:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789123194.915574:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c3070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+14:10444:x1876031364464384:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 Request processed in 606us (2255us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1789123194.915584:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 35 00000100:00100000:2.0:1789123195.127776:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123195.131499:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364464512 00000100:00100000:1.0:1789123195.131518:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364464512 00000100:00100000:1.0:1789123195.131647:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 136 00000100:00100000:1.0:1789123195.131662:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:11235:x1876031364464512:12345-192.168.206.30@tcp:101:lsof.0 00000100:00080000:3.0:1789123195.131670:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789123195.131688:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123195.131716:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc92473 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f733 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123195.131808:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc9247a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123195.131825:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc9247a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123195.131850:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc9247a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123195.132071:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789123195.132080:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1789123195.132178:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc9247a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123195.132206:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc92473 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f733 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123195.132225:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc9247a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f733 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123195.132235:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34232f7f00) 00010000:00010000:1.0:1789123195.132238:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789123195.132242:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd33000, rc 0) 00000100:00100000:1.0:1789123195.132326:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:949e01ae-fd37-4d7e-878c-bf5e18b249e6+6:11235:x1876031364464512:12345-192.168.206.30@tcp:101:lsof.0 Request processed in 669us (4565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123195.132333:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 136 00010000:00010000:2.0:1789123195.396860:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123195.909195:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789123195.909227:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d32b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381251456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789123195.909333:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123195.909623:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d32b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381251712:0@lo:400:kworker.0 00000100:00100000:0.0:1789123195.909680:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123195.909704:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789123195.909709:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d329e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381251840:0@lo:400:kworker.0 00000100:00100000:0.0:1789123195.909732:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123195.909759:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381251712 00000100:00100000:0.0:1789123195.909767:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381251712 00000100:00100000:0.0:1789123195.909814:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381251840 00000100:00100000:0.0:1789123195.909817:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381251840 00000100:00100000:0.0:1789123195.909851:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789123195.909861:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381251712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123195.909918:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381251712:12345-0@lo:400:kworker.0 Request processed in 58us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123195.909926:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789123195.909944:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789123195.909951:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381251840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123195.909996:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381251840:12345-0@lo:400:kworker.0 Request processed in 45us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123195.910002:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:0.0:1789123195.910020:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789123195.910054:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d329e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381251840:0@lo:400:kworker.0 00000100:00100000:0.0:1789123195.910064:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d32b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381251712:0@lo:400:kworker.0 00000100:00100000:2.0:1789123195.912862:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381251456 00000100:00100000:2.0:1789123195.912883:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381251456 00000100:00100000:2.0:1789123195.912988:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789123195.913000:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3441ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381251456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789123195.913053:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123195.913161:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3441ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381251456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 162us (3826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123195.913168:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789123195.913696:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d3292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381251584:0@lo:400:kworker.0 00000100:00100000:3.0:1789123195.913753:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123195.913810:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381252096:0@lo:400:kworker.0 00000100:00100000:3.0:1789123195.913840:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123195.913880:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1789123195.913887:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967312 00000004:00080000:3.0:1789123195.913909:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f34355f1e00, transno 4294967312 00000100:00100000:3.0:1789123195.913934:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d32b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381251456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789123195.913954:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789123195.913962:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381251968:0@lo:400:kworker.0 00000100:00100000:3.0:1789123195.913992:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123195.914586:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381251968 00000100:00100000:1.0:1789123195.914594:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381251968 00000100:00100000:1.0:1789123195.914685:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789123195.914696:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381251968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123195.914768:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381251968:12345-0@lo:400:kworker.0 Request processed in 74us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123195.914776:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789123195.914803:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381252096 00000100:00100000:1.0:1789123195.914807:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381252096 00000100:00100000:1.0:1789123195.914840:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789123195.914847:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876031381252096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123195.914880:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876031381252096:12345-0@lo:400:kworker.0 Request processed in 33us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123195.914895:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789123195.914934:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381251968:0@lo:400:kworker.0 00000100:00100000:1.0:1789123195.914947:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381252096:0@lo:400:kworker.0 00000100:00080000:0.0:1789123195.918889:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789123195.918907:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789123195.918911:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789123195.922381:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381251584 00000100:00100000:2.0:1789123195.922400:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381251584 00000100:00100000:2.0:1789123195.922478:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1789123195.922491:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3305:x1876031381251584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123195.922666:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3305:x1876031381251584:12345-0@lo:400:kworker.0 Request processed in 177us (8912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123195.922675:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1789123195.923787:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d3292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381251584:0@lo:400:kworker.0 00010000:00010000:0.0:1789123196.421429:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789123196.467797:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1789123196.467967:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1789123196.468003:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1789123196.468013:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789123197.447033:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381252224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789123197.447101:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789123197.447229:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123197.447618:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381252224 00000100:00100000:1.0:1789123197.447652:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381252224 00000100:00100000:1.0:1789123197.447722:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789123197.447730:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381252224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789123197.447764:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789123197.447820:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381252224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123197.447827:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789123197.447977:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381252224:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789123197.448938:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789123198.468806:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123198.883479:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123198.883521:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123198.883554:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123198.883574:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123198.883597:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123198.883673:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364464640 00000100:00100000:2.0:1789123198.883698:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364464640 00000100:00100000:2.0:1789123198.883744:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 319 00000100:00100000:2.0:1789123198.883754:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+13:2352:x1876031364464640:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1789123198.883821:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405da5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+13:2352:x1876031364464640:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 69us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123198.883829:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 319 00000100:00100000:1.0:1789123198.889662:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364464896 00000100:00100000:1.0:1789123198.889677:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364464896 00000100:00100000:1.0:1789123198.889738:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364465024 00000100:00100000:1.0:1789123198.889741:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364465024 00000100:00100000:1.0:1789123198.889771:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 76 00000100:00100000:1.0:1789123198.889781:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2352:x1876031364464896:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123198.889858:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2352:x1876031364464896:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 78us (6335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123198.889865:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 76 00000100:00100000:1.0:1789123198.889881:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 77 00000100:00100000:1.0:1789123198.889887:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b4b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2352:x1876031364465024:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123198.889912:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b4b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2352:x1876031364465024:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 25us (6314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123198.889929:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 77 00000100:00100000:1.0:1789123198.889952:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364465152 00000100:00100000:1.0:1789123198.889956:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364465152 00000100:00100000:1.0:1789123198.889981:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364464768 00000100:00100000:1.0:1789123198.889984:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364464768 00000100:00100000:1.0:1789123198.890005:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 154 00000100:00100000:1.0:1789123198.890013:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:949e01ae-fd37-4d7e-878c-bf5e18b249e6+6:2352:x1876031364465152:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123198.890043:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:949e01ae-fd37-4d7e-878c-bf5e18b249e6+6:2352:x1876031364465152:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 31us (6489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123198.890048:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 154 00000100:00100000:1.0:1789123198.890060:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 155 00000100:00100000:1.0:1789123198.890066:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+13:2352:x1876031364464768:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123198.890092:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+13:2352:x1876031364464768:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 26us (6517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123198.890098:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 155 00000100:00080000:1.0:1789123198.890129:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789123198.890134:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789123198.890135:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1789123199.257549:0:12654:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 06:39:56 (1789123196) 00010000:00010000:3.0:1789123199.497737:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123200.540579:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123201.030872:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c30cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876031381252608:0@lo:400:kworker.0 00000100:00100000:2.0:1789123201.030936:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123201.030992:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343fc05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381253120:0@lo:400:kworker.0 00000100:00100000:2.0:1789123201.031016:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123201.031035:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381252608 00000100:00100000:2.0:1789123201.031043:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789123201.031043:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381252608 00000100:00100000:2.0:1789123201.031048:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c30f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381252480:0@lo:400:kworker.0 00000100:00100000:2.0:1789123201.031074:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123201.031083:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789123201.031091:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876031381252608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123201.031092:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343fc043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381252992:0@lo:400:kworker.0 00000100:00100000:2.0:1789123201.031112:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123201.031136:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876031381252608:12345-0@lo:400:kworker.0 Request processed in 46us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123201.031137:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381253120 00000100:00100000:2.0:1789123201.031141:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381253120 00000100:00100000:1.0:1789123201.031143:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789123201.031158:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381252992 00000100:00100000:2.0:1789123201.031175:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789123201.031175:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381252992 00000100:00100000:2.0:1789123201.031180:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381253120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123201.031196:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789123201.031201:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876031381252992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123201.031209:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381253120:12345-0@lo:400:kworker.0 Request processed in 29us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123201.031214:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789123201.031233:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381252480 00000100:00100000:2.0:1789123201.031236:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381252480 00000100:00100000:2.0:1789123201.031265:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1789123201.031271:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3305:x1876031381252480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123201.031302:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3305:x1876031381252480:12345-0@lo:400:kworker.0 Request processed in 31us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123201.031308:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00080000:2.0:1789123201.031356:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789123201.031360:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789123201.031384:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c30f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd41f4a0-f4e3-41a1-856e-0c34af912023:3305:1876031381252480:0@lo:400:kworker.0 00000100:00100000:2.0:1789123201.031396:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c30cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876031381252608:0@lo:400:kworker.0 00000100:00100000:2.0:1789123201.031404:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343fc05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381253120:0@lo:400:kworker.0 00000100:00100000:3.0:1789123201.031509:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381252352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789123201.031539:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123201.031658:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343fc07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381252736:0@lo:400:kworker.0 00000100:00100000:0.0:1789123201.031687:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123201.032607:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876031381252992:12345-0@lo:400:kworker.0 Request processed in 1403us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123201.032616:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789123201.032654:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381252736 00000100:00100000:1.0:1789123201.032658:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381252736 00000100:00100000:1.0:1789123201.032963:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789123201.032971:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381252736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123201.033006:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381252736:12345-0@lo:400:kworker.0 Request processed in 37us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123201.033012:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:1.0:1789123201.033035:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789123201.035988:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343fc070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381252864:0@lo:400:kworker.0 00000100:00100000:3.0:1789123201.036052:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123201.037074:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343fc07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381252736:0@lo:400:kworker.0 00000100:00100000:2.0:1789123201.037097:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381252352 00000100:00100000:2.0:1789123201.037105:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381252352 00000100:00100000:0.0:1789123201.037114:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343fc043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381252992:0@lo:400:kworker.0 00000100:00100000:2.0:1789123201.037151:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789123201.037157:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1789123201.037160:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381252352:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789123201.037164:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:2.0:1789123201.037196:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123201.037339:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381252352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 179us (5799us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123201.037345:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789123201.037424:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381252352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789123201.037951:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381252864 00000100:00100000:1.0:1789123201.037957:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381252864 00000100:00100000:1.0:1789123201.038011:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789123201.038019:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381252864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123201.038065:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381252864:12345-0@lo:400:kworker.0 Request processed in 47us (2013us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123201.038071:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1789123201.038128:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789123201.038373:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343fc070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381252864:0@lo:400:kworker.0 00000100:00100000:0.0:1789123201.126430:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123201.126576:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364465408 00000100:00100000:2.0:1789123201.126586:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364465408 00000100:00100000:2.0:1789123201.126703:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 137 00000100:00100000:2.0:1789123201.126715:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+13:11500:x1876031364465408:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789123201.126735:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123201.126755:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92481 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f73a expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123201.126846:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92488 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123201.126862:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92488 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123201.126875:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92488 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123201.126889:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9248f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123201.126896:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9248f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123201.126903:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9248f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123201.127514:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc92496 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123201.127526:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc92496 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123201.127533:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc92496 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123201.127543:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1789123201.127748:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92488 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123201.127755:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92488 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123201.127767:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92488 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123201.127773:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80b600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123201.127776:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92488 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123201.127784:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92488 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123201.127796:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f34232f7a00) 00010000:00010000:2.0:1789123201.127799:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123201.127803:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92488 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123201.127809:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92488 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123201.127820:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9248f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123201.127825:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9248f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123201.127830:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9248f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123201.127835:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123201.127837:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9248f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123201.127854:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9248f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123201.127862:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9f34232f7b00) 00010000:00010000:2.0:1789123201.127864:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123201.127867:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9248f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123201.127873:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9248f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123201.128224:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92481 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f73a expref: 16 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123201.128239:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc92496 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f73a expref: 15 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123201.128246:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f3411751e00) 00010000:00010000:2.0:1789123201.128248:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123201.128251:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80ba00, rc 0) 00000100:00100000:2.0:1789123201.128325:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+15:11500:x1876031364465408:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 1612us (1903us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1789123201.128334:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 137 00000100:00080000:1.0:1789123201.128940:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789123201.136053:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123201.136107:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123201.136134:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364465536 00000100:00100000:2.0:1789123201.136150:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364465536 00000100:00100000:3.0:1789123201.136214:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364465664 00000100:00100000:3.0:1789123201.136224:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364465664 00000100:00100000:2.0:1789123201.136240:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 138 00000100:00100000:2.0:1789123201.136256:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343fc070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+16:11500:x1876031364465536:12345-192.168.206.30@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789123201.136307:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00100000:3.0:1789123201.136331:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343fc043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+16:2355:x1876031364465664:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789123201.136351:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123201.136387:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc92496 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f73a expref: 16 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123201.136409:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f3411751e00) 00010000:00010000:3.0:1789123201.136415:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789123201.136466:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343fc043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+15:2355:x1876031364465664:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 140us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123201.136475:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00100000:2.0:1789123201.136974:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343fc070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+14:11500:x1876031364465536:12345-192.168.206.30@tcp:59:lhsmtool_posix.0 Request processed in 719us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123201.136984:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 138 00010000:00010000:3.0:1789123201.542297:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789123201.598252:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000040:00080000:3.0:1789123202.065049:0:12081:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789123202.065060:0:12081:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789123202.066128:0:12081:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1789123202.069665:0:12081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789123202.564766:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123202.581137:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c30cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381253248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789123202.581216:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123202.584068:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381253248 00000100:00100000:3.0:1789123202.584083:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381253248 00000100:00100000:3.0:1789123202.584141:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789123202.584151:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381253248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789123202.584190:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789123202.584282:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381253248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (3065us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123202.584290:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789123202.584376:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c30cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381253248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789123203.255012:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123203.255225:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364465792 00000100:00100000:1.0:1789123203.255235:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364465792 00000100:00100000:1.0:1789123203.255326:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 139 00000100:00100000:1.0:1789123203.255337:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+13:11542:x1876031364465792:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1789123203.255368:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123203.255386:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc924a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f741 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.255441:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc924ab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.255455:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc924ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.255468:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc924ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.255481:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc924b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.255488:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc924b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.255499:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc924b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.255743:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc924ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.255751:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc924ab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.255758:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc924ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.255764:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33c00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123203.255772:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc924ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.255779:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc924ab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.255791:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34232f7f00) 00010000:00010000:1.0:1789123203.255793:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123203.255798:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc924ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.255804:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc924ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.255815:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc924b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.255821:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc924b2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.255827:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc924b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.255831:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32a00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123203.255844:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc924b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.255850:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc924b2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.255858:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9f340534df00) 00010000:00010000:1.0:1789123203.255860:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123203.255869:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc924b2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.255875:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc924b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.255907:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc924a4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f741 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.255917:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34232f7f00) 00010000:00010000:1.0:1789123203.255919:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123203.255923:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc924a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f741 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.255932:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd33800, rc 0) 00000100:00100000:1.0:1789123203.255987:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+13:11542:x1876031364465792:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 653us (985us total) trans 0 rc 301/301 00000100:00100000:1.0:1789123203.255994:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 139 00000100:00080000:3.0:1789123203.259381:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789123203.260898:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123203.261030:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364466048 00000100:00100000:1.0:1789123203.261039:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364466048 00000100:00100000:1.0:1789123203.261084:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 140 00000100:00100000:1.0:1789123203.261093:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+13:11542:x1876031364466048:12345-192.168.206.30@tcp:36:lfs.0 00010000:00010000:1.0:1789123203.261145:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123203.261170:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc91e22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f57a expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.261365:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34232f7f00) 00010000:00010000:1.0:1789123203.261372:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789123203.261736:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc924b9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.261751:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc9247a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f733 expref: 5 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.261760:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc924b9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.261792:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc9247a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f733 expref: 5 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.261807:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc9247a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f733 expref: 5 pid: 5842 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123203.261821:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343fc07840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876031381253376:192.168.206.30@tcp:104: 00000100:00100000:1.0:1789123203.262077:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3418b9b300 going to sleep for 11 seconds 00000100:00100000:3.0:1789123203.276858:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343fc07840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876031381253376:192.168.206.30@tcp:104: 00010000:00010000:3.0:1789123203.276888:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc924b9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123203.277780:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123203.277854:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364466176 00000100:00100000:1.0:1789123203.277865:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364466176 00010000:00010000:1.0:1789123203.277935:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc9247a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f733 expref: 6 pid: 5842 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123203.277984:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 65 00000100:00100000:1.0:1789123203.277995:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f52940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:949e01ae-fd37-4d7e-878c-bf5e18b249e6+6:2355:x1876031364466176:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789123203.278010:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123203.278017:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc9247a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f733 expref: 6 pid: 5842 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.278030:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc9247a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f733 expref: 6 pid: 5842 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.278070:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc9247a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f733 expref: 6 pid: 5842 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.278088:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34232f7f00) 00010000:00010000:1.0:1789123203.278094:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc924b9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.278103:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc924b9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.278110:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc924b9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.278134:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789123203.278149:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc924b9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.278156:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc924b9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.278178:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc924c0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123203.278186:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f52940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2355:x1876031364466176:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 194us (418us total) trans 0 rc 0/0 00010000:00010000:0.0:1789123203.278188:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc924c0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123203.278194:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 65 00010000:00010000:0.0:1789123203.278195:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc924c0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789123203.278611:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1789123203.287078:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1789123203.287097:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc924b9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.287107:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc924b9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.287115:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc924b9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.287121:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32200 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123203.287126:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc924b9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.287147:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc924b9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.287163:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34232f7f00) 00010000:00010000:0.0:1789123203.287166:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123203.287171:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc924b9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.287177:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc924b9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789123203.287198:0:5840:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000009636c82d reply state 00000000be85a413 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc924c0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123203.287208:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789123203.287323:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+14:11542:x1876031364466048:12345-192.168.206.30@tcp:36:lfs.0 Request processed in 26226us (26427us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1789123203.287331:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 140 00010000:00010000:0.0:1789123203.290610:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc924c0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.290645:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc924c0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.290653:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc924c0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.290659:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52a00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123203.290664:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc924c0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.290687:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc924c0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.290703:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9f34226c1a00) 00010000:00010000:0.0:1789123203.290706:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123203.290711:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc924c0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.290717:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc924c0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123203.376535:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123203.376666:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364466304 00000100:00100000:0.0:1789123203.376675:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364466304 00000100:00100000:0.0:1789123203.376732:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 141 00000100:00100000:0.0:1789123203.376743:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343fc05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+13:11550:x1876031364466304:12345-192.168.206.30@tcp:101:lctl.0 00010000:00010000:0.0:1789123203.376765:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123203.376786:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc924c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f748 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.376848:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc924ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.376862:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc924ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.376887:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc924ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123203.376944:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789123203.376977:0:7640:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1789123203.377009:0:7640:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc924ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.377033:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc924c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f748 expref: 15 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.377048:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc924ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f748 expref: 14 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.377056:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34226c1a00) 00010000:00010000:0.0:1789123203.377059:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789123203.377063:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53c00, rc 0) 00000100:00100000:0.0:1789123203.377117:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343fc05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+14:11550:x1876031364466304:12345-192.168.206.30@tcp:101:lctl.0 Request processed in 376us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123203.377124:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 141 00000100:00100000:2.0:1789123203.462249:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123203.462656:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364466432 00000100:00100000:3.0:1789123203.462666:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364466432 00000100:00100000:3.0:1789123203.462729:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 142 00000100:00100000:3.0:1789123203.462739:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+14:11556:x1876031364466432:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:3.0:1789123203.462759:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123203.462779:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc924d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f74f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.462842:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbac00/0x7e1648d68fc924dc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.462857:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbac00/0x7e1648d68fc924dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.462885:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbac00/0x7e1648d68fc924dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.462925:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc924e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.462934:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc924e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.462941:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc924e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.463106:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbaa00/0x7e1648d68fc924ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.463115:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbaa00/0x7e1648d68fc924ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.463122:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbaa00/0x7e1648d68fc924ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123203.463152:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1789123203.463155:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789123203.463177:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbaa00/0x7e1648d68fc924ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.463187:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbac00/0x7e1648d68fc924dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.463193:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbac00/0x7e1648d68fc924dc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.463200:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbac00/0x7e1648d68fc924dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.463216:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbac00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123203.463220:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbac00/0x7e1648d68fc924dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.463228:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbac00/0x7e1648d68fc924dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.463239:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34226c1a00) 00010000:00010000:3.0:1789123203.463243:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123203.463247:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbac00/0x7e1648d68fc924dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.463253:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbac00/0x7e1648d68fc924dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.463267:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc924e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.463273:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc924e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.463279:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc924e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.463285:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbae00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123203.463288:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc924e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.463293:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc924e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.463322:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9f3411751600) 00010000:00010000:3.0:1789123203.463325:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123203.463327:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc924e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.463333:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc924e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.463361:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc924d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f74f expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.463376:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbaa00/0x7e1648d68fc924ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f74f expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.463382:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:3.0:1789123203.463384:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789123203.463386:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbaa00, rc 0) 00000100:00100000:3.0:1789123203.463451:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+15:11556:x1876031364466432:12345-192.168.206.30@tcp:101:bash.0 Request processed in 713us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123203.463458:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 142 00000100:00100000:2.0:1789123203.465703:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123203.465796:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364466688 00000100:00100000:1.0:1789123203.465804:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364466688 00000100:00100000:1.0:1789123203.465850:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 143 00000100:00100000:1.0:1789123203.465859:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+15:11556:x1876031364466688:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:1.0:1789123203.465878:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123203.465896:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc924f1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f756 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.466027:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc924f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.466055:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc924f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.466066:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc924f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.466128:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc924ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.466135:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc924ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.466142:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc924ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789123203.466726:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1789123203.466884:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc92506 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.466896:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc92506 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.466904:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc92506 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.466936:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc924f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.466943:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc924f8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.466949:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc924f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.466962:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32a00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123203.466966:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc924f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.466973:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc924f8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.466985:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:1.0:1789123203.466988:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123203.466993:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc924f8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.466999:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc924f8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789123203.467012:0:5841:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000074a5bd45 reply state 00000000631effd2 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc924ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123203.467021:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789123203.467050:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc924f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f756 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.467063:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc92506 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f756 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.467070:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f340534d400) 00010000:00010000:1.0:1789123203.467072:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789123203.467074:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd32e00, rc 0) 00000100:00100000:1.0:1789123203.467133:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+18:11556:x1876031364466688:12345-192.168.206.30@tcp:101:bash.0 Request processed in 1275us (1438us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1789123203.467147:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 143 00000100:00100000:1.0:1789123203.470247:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123203.470557:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364466816 00000100:00100000:3.0:1789123203.470567:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364466816 00000100:00100000:3.0:1789123203.470662:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 47 00000100:00100000:3.0:1789123203.470673:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343fc07840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2355:x1876031364466816:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:3.0:1789123203.470691:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123203.470712:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f48b05fc/0x7e1648d68fc92514 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f75d expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789123203.470763:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789123203.470783:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=317s v=(0 0) 00010000:00010000:3.0:1789123203.470787:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789123203.470797:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f48b05fc/0x7e1648d68fc92514 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f75d expref: 6 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.470816:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f48b05fc/0x7e1648d68fc92514 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f75d expref: 6 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.470830:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbb200, rc 0) 00000100:00100000:3.0:1789123203.470887:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343fc07840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2355:x1876031364466816:12345-192.168.206.30@tcp:101:bash.0 Request processed in 217us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123203.470894:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 47 00000100:00080000:1.0:1789123203.471521:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789123203.473089:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00010000:00010000:2.0:1789123203.474392:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc924ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123203.474408:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc924ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123203.474416:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc924ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123203.474423:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33c00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123203.474428:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc924ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123203.474435:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc924ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123203.474452:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f340534df00) 00010000:00010000:2.0:1789123203.474455:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123203.474460:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc924ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123203.474466:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc924ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123203.479045:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364466944 00000100:00100000:3.0:1789123203.479058:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364466944 00000100:00100000:3.0:1789123203.479171:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 48 00000100:00100000:3.0:1789123203.479193:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3404938b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+6:11556:x1876031364466944:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:3.0:1789123203.479212:0:8519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123203.479229:0:8519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012f3539b/0x7e1648d68fc9251b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f764 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.479262:0:8519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f48b05fc/0x7e1648d68fc92514 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f75d expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.479312:0:8519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789123203.479316:0:8519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789123203.479323:0:8519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012f3539b/0x7e1648d68fc9251b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f764 expref: 7 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.479365:0:8519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f48b05fc/0x7e1648d68fc92514 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f75d expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.479379:0:8519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f48b05fc/0x7e1648d68fc92514 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f75d expref: 7 pid: 6688 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123203.479393:0:8519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3301f50b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8519:1876031381253504:192.168.206.30@tcp:104: 00000100:00100000:3.0:1789123203.479488:0:8519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3303e6c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789123203.483185:0:8519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3301f50b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8519:1876031381253504:192.168.206.30@tcp:104: 00010000:00010000:3.0:1789123203.483230:0:8519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012f3539b/0x7e1648d68fc9251b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f764 expref: 7 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.483251:0:8519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbae00, rc 0) 00000100:00100000:3.0:1789123203.483319:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3404938b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+7:11556:x1876031364466944:12345-192.168.206.30@tcp:101:bash.0 Request processed in 4138us (10237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123203.483328:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 48 00000100:00100000:2.0:1789123203.483808:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123203.483981:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364467072 00000100:00100000:3.0:1789123203.483989:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364467072 00010000:00010000:3.0:1789123203.484023:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f48b05fc/0x7e1648d68fc92514 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f75d expref: 7 pid: 6688 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123203.484070:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 66 00000100:00100000:3.0:1789123203.484079:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3406285050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2354:x1876031364467072:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789123203.484092:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123203.484112:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f48b05fc/0x7e1648d68fc92514 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f75d expref: 7 pid: 6688 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.484126:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f48b05fc/0x7e1648d68fc92514 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f75d expref: 7 pid: 6688 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.484150:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f48b05fc/0x7e1648d68fc92514 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f75d expref: 7 pid: 6688 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.484165:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789123203.484170:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789123203.484178:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012f3539b/0x7e1648d68fc9251b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f764 expref: 6 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.484189:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012f3539b/0x7e1648d68fc9251b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f764 expref: 6 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.484221:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000012f3539b/0x7e1648d68fc9251b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f764 expref: 6 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123203.484236:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3301f50b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1876031381253632:192.168.206.30@tcp:105: 00000100:00100000:3.0:1789123203.484321:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3303e6c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789123203.489932:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3301f50b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1876031381253632:192.168.206.30@tcp:105: 00010000:00010000:3.0:1789123203.489960:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789123203.490016:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3406285050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2354:x1876031364467072:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 5937us (6209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123203.490027:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 66 00000100:00100000:2.0:1789123203.491729:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123203.491988:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364467328 00000100:00100000:1.0:1789123203.491997:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364467328 00000100:00100000:1.0:1789123203.492049:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 36 00000100:00100000:1.0:1789123203.492059:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+17:11556:x1876031364467328:12345-192.168.206.30@tcp:35:bash.0 00000100:00100000:1.0:1789123203.492396:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+18:11556:x1876031364467328:12345-192.168.206.30@tcp:35:bash.0 Request processed in 337us (674us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1789123203.492404:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 36 00010000:00010000:3.0:1789123203.590504:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123203.598714:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123203.598809:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364467584 00000100:00100000:3.0:1789123203.598822:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364467584 00000100:00100000:3.0:1789123203.598905:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 144 00000100:00100000:3.0:1789123203.598918:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+18:11566:x1876031364467584:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:3.0:1789123203.598950:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123203.598977:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc92522 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f76b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123203.599122:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1789123203.599472:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc92522 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f76b expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.599490:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34226c1a00) 00010000:00010000:3.0:1789123203.599493:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789123203.599499:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc92522 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f76b expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.599515:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbb200, rc 0) 00000100:00100000:3.0:1789123203.599594:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+19:11566:x1876031364467584:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 678us (895us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1789123203.599619:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 144 00000100:00100000:3.0:1789123203.603718:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123203.603832:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364467840 00000100:00100000:2.0:1789123203.603845:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364467840 00000100:00100000:2.0:1789123203.603956:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 37 00000100:00100000:2.0:1789123203.603968:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+19:11566:x1876031364467840:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:2.0:1789123203.604332:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+20:11566:x1876031364467840:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 365us (626us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1789123203.604341:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 37 00000100:00100000:2.0:1789123203.672777:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123203.672915:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364467968 00000100:00100000:0.0:1789123203.672929:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364467968 00000100:00100000:0.0:1789123203.672999:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 145 00000100:00100000:0.0:1789123203.673010:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+20:11572:x1876031364467968:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:0.0:1789123203.673042:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123203.673080:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc92530 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f772 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.673160:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92537 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.673178:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.673220:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123203.673308:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1789123203.673313:0:7640:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789123203.673341:0:7640:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.673373:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc92530 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f772 expref: 22 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.673394:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92537 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f772 expref: 21 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.673403:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:0.0:1789123203.673406:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789123203.673410:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53a00, rc 0) 00000100:00100000:0.0:1789123203.673484:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+21:11572:x1876031364467968:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 475us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123203.673492:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 145 00000100:00100000:0.0:1789123203.680043:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123203.680538:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364468224 00000100:00100000:3.0:1789123203.680552:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364468224 00000100:00100000:3.0:1789123203.680806:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 146 00000100:00100000:3.0:1789123203.680820:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+21:11572:x1876031364468224:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:3.0:1789123203.680848:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123203.680876:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc9253e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f779 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.681004:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbac00/0x7e1648d68fc92545 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.681024:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbac00/0x7e1648d68fc92545 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.681038:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbac00/0x7e1648d68fc92545 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123203.681052:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789123203.682415:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc9253e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f779 expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.682447:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbac00/0x7e1648d68fc92545 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f779 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.682459:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f340534d400) 00010000:00010000:3.0:1789123203.682462:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789123203.682480:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbac00, rc 0) 00000100:00100000:3.0:1789123203.682654:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+23:11572:x1876031364468224:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 1836us (2625us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1789123203.682664:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 146 00000100:00100000:1.0:1789123203.690286:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123203.690377:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123203.690456:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364468608 00000100:00100000:2.0:1789123203.690468:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364468608 00000100:00100000:2.0:1789123203.690580:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 10 00000100:00100000:2.0:1789123203.690592:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340493a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+23:2353:x1876031364468608:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789123203.690618:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123203.690688:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbac00/0x7e1648d68fc92545 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f779 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123203.690710:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f340534d400) 00010000:00010000:2.0:1789123203.690716:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123203.690786:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340493a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+22:2353:x1876031364468608:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 196us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123203.690795:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 10 00000100:00100000:0.0:1789123203.690859:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364468480 00000100:00100000:0.0:1789123203.690864:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364468480 00000100:00100000:0.0:1789123203.690897:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 147 00000100:00100000:0.0:1789123203.690904:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3404939680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+22:11572:x1876031364468480:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:0.0:1789123203.690927:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123203.690947:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc92553 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f780 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.691091:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc9255a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.691108:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc9255a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.691121:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc9255a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123203.691135:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789123203.691307:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc92553 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f780 expref: 25 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.691324:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc9255a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f780 expref: 24 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.691331:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f340534d400) 00010000:00010000:0.0:1789123203.691334:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789123203.691337:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b52400, rc 0) 00000100:00100000:0.0:1789123203.691367:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3404939680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+24:11572:x1876031364468480:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 463us (1095us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1789123203.691374:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 147 00000100:00100000:0.0:1789123203.695876:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123203.695959:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364468736 00000100:00100000:3.0:1789123203.695971:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364468736 00000100:00100000:3.0:1789123203.696035:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 49 00000100:00100000:3.0:1789123203.696046:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d3292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2355:x1876031364468736:12345-192.168.206.30@tcp:1:lfs.0 00010000:00010000:3.0:1789123203.696112:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a61bb24/0x7e1648d68fc92568 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.696136:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012f3539b/0x7e1648d68fc9251b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f764 expref: 6 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.696145:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789123203.696150:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789123203.696156:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a61bb24/0x7e1648d68fc92568 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.696207:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000012f3539b/0x7e1648d68fc9251b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f764 expref: 6 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.696223:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000012f3539b/0x7e1648d68fc9251b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f764 expref: 6 pid: 8519 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123203.696240:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3301f50b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1876031381253760:192.168.206.30@tcp:104: 00000100:00100000:3.0:1789123203.696358:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3303e6cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789123203.699343:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123203.699382:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364468864 00000100:00100000:0.0:1789123203.699393:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364468864 00002000:00100000:0.0:1789123203.699460:0:6693:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9f342d32b0c0 x1876031364468864/t0(0) o4->64de9449-4320-4c9f-abcb-230edd2b11ae@192.168.206.30@tcp:469/0 lens 504/0 e 0 to 0 dl 1789123214 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789123203.699492:0:6693:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9f342d32b0c0 with x1876031364468864 ext(0->12) 00010000:00010000:0.0:1789123203.699506:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000012f3539b/0x7e1648d68fc9251b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f764 expref: 7 pid: 8519 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.699525:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000012f3539b/0x7e1648d68fc9251b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f764 expref: 7 pid: 8519 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789123203.699534:0:6693:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9f342d32b0c0 00000100:00100000:0.0:1789123203.699567:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 2 00000100:00100000:0.0:1789123203.699578:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d32b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2354:x1876031364468864:12345-192.168.206.30@tcp:4:lfs.0 00000100:00100000:0.0:1789123203.700271:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d32b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+9:2354:x1876031364468864:12345-192.168.206.30@tcp:4:lfs.0 Request processed in 689us (936us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789123203.700281:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 2 00002000:00100000:0.0:1789123203.700290:0:6693:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9f342d32b0c0 x1876031364468864/t4294967305(0) o4->64de9449-4320-4c9f-abcb-230edd2b11ae@192.168.206.30@tcp:469/0 lens 504/448 e 0 to 0 dl 1789123214 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789123203.700311:0:6693:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9f342d32b0c0 with x1876031364468864 ext(0->12) 00010000:00010000:0.0:1789123203.700319:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000012f3539b/0x7e1648d68fc9251b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f764 expref: 9 pid: 8519 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.700332:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000012f3539b/0x7e1648d68fc9251b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f764 expref: 9 pid: 8519 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789123203.700339:0:6693:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9f342d32b0c0 00000100:00100000:3.0:1789123203.702333:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3301f50b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1876031381253760:192.168.206.30@tcp:104: 00010000:00010000:3.0:1789123203.702368:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003a61bb24/0x7e1648d68fc92568 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123203.703015:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123203.703173:0:11614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364468992 00000100:00100000:2.0:1789123203.703183:0:11614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364468992 00010000:00010000:2.0:1789123203.703310:0:11614:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000012f3539b/0x7e1648d68fc9251b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f764 expref: 9 pid: 8519 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123203.703399:0:11614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 67 00000100:00100000:2.0:1789123203.703411:0:11614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d32a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+9:2353:x1876031364468992:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789123203.703432:0:11614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789123203.703454:0:11614:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789123203.703457:0:11614:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789123203 00002000:00010000:2.0:1789123203.703460:0:11614:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789123203 00002000:00010000:2.0:1789123203.703462:0:11614:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789123203 00010000:00010000:2.0:1789123203.703469:0:11614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000012f3539b/0x7e1648d68fc9251b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f764 expref: 9 pid: 8519 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123203.703483:0:11614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000012f3539b/0x7e1648d68fc9251b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f764 expref: 9 pid: 8519 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123203.703515:0:11614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012f3539b/0x7e1648d68fc9251b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f764 expref: 9 pid: 8519 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123203.703534:0:11614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789123203.703539:0:11614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789123203.703545:0:11614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a61bb24/0x7e1648d68fc92568 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123203.703556:0:11614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a61bb24/0x7e1648d68fc92568 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123203.703593:0:11614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123203.703706:0:11614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d32a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+8:2353:x1876031364468992:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 297us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123203.703715:0:11614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 67 00010000:00010000:0.0:1789123203.703946:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003a61bb24/0x7e1648d68fc92568 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.703957:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a61bb24/0x7e1648d68fc92568 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.703987:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a61bb24/0x7e1648d68fc92568 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.703996:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a61bb24/0x7e1648d68fc92568 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.704005:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a61bb24/0x7e1648d68fc92568 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.704013:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbb600 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:0.0:1789123203.704018:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a61bb24/0x7e1648d68fc92568 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.704029:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a61bb24/0x7e1648d68fc92568 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.704043:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a61bb24/0x7e1648d68fc92568 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.704052:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a61bb24/0x7e1648d68fc92568 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123203.704138:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d3292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2355:x1876031364468736:12345-192.168.206.30@tcp:1:lfs.0 Request processed in 8093us (8277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123203.704146:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 49 00000100:00100000:1.0:1789123203.709273:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123203.709382:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364469248 00000100:00100000:3.0:1789123203.709396:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364469248 00000100:00100000:3.0:1789123203.709490:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 38 00000100:00100000:3.0:1789123203.709502:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427abdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+24:11572:x1876031364469248:12345-192.168.206.30@tcp:35:lfs.0 00000004:00010000:3.0:1789123203.709586:0:5843:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc9255a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f780 expref: 24 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789123203.709997:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1789123203.710043:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1789123203.711542:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1789123203.711805:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc9256f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.711827:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc92506 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f756 expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.711836:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc9256f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.711883:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc92506 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f756 expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.711902:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc92506 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f756 expref: 28 pid: 5841 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123203.711918:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d329680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5843:1876031381253888:192.168.206.30@tcp:104: 00000100:00100000:0.0:1789123203.712073:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34359109c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123203.715482:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123203.715950:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364469376 00000100:00100000:2.0:1789123203.715962:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364469376 00010000:00010000:2.0:1789123203.716013:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc92506 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f756 expref: 29 pid: 5841 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123203.716073:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 68 00000100:00100000:2.0:1789123203.716084:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340493bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+29:2355:x1876031364469376:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789123203.716104:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123203.716111:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc92506 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f756 expref: 29 pid: 5841 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123203.716127:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc92506 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f756 expref: 29 pid: 5841 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123203.716155:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f340534d400) 00010000:00010000:2.0:1789123203.716161:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc9256f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123203.716171:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc9256f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123203.716179:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc9256f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123203.716213:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123203.716277:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340493bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+29:2355:x1876031364469376:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 194us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123203.716309:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 68 00010000:00010000:0.0:1789123203.717449:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc92506 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f756 expref: 28 pid: 5841 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123203.717479:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d329680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5843:1876031381253888:192.168.206.30@tcp:104: 00010000:00010000:0.0:1789123203.717507:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc9256f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.717530:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc9256f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123203.717536:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc9256f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789123203.720551:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1789123203.721160:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1789123203.721336:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d329680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1876031381254016:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789123203.721430:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123203.721479:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3435910900 going to sleep for 11 seconds 00000100:00100000:1.0:1789123203.721664:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381254016 00000100:00100000:1.0:1789123203.721674:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381254016 00000100:00100000:1.0:1789123203.721756:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789123203.721767:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d32b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1876031381254016:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789123203.721863:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d32b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1876031381254016:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 97us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123203.721871:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789123203.721922:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d329680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1876031381254016:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:3.0:1789123203.722288:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789123203.722828:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1789123203.722914:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f340493a1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1876031381254144:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789123203.722991:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123203.723062:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3418b9b900 going to sleep for 11 seconds 00000100:00100000:0.0:1789123203.723169:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381254144 00000100:00100000:0.0:1789123203.723176:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381254144 00000100:00100000:0.0:1789123203.723323:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789123203.723332:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3404939e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1876031381254144:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789123203.723542:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3404939e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1876031381254144:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 210us (551us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789123203.723550:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789123203.723606:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f340493a1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1876031381254144:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789123203.723702:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1789123203.723748:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc9256f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123203.723759:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc9256f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123203.723767:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc9256f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123203.723774:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52800 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123203.723779:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc9256f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123203.723788:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc9256f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123203.723807:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f340534d400) 00010000:00010000:2.0:1789123203.723810:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789123203.723816:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc9256f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123203.723822:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc9256f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789123203.724016:0:5843:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789123203.724134:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1789123203.724146:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 318054517628ns, next at 319054515033ns, rc = 0 00000001:00080000:2.0:1789123203.724163:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1789123203.724402:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f340534d400) 00010000:00010000:2.0:1789123203.724406:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789123203.724414:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc9255a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f780 expref: 32 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123203.724590:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427abdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+31:11572:x1876031364469248:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 15088us (15394us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1789123203.724601:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 38 00000020:00080000:2.0:1789123203.724615:0:5843:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789123203.727356:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123203.727445:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364469504 00000100:00100000:3.0:1789123203.727456:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364469504 00000100:00100000:3.0:1789123203.727526:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 148 00000100:00100000:3.0:1789123203.727538:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+31:11572:x1876031364469504:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:3.0:1789123203.727566:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123203.727595:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc92576 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f787 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.727871:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc92576 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f787 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.727888:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc92576 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f787 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.727932:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f3411751200) 00010000:00010000:3.0:1789123203.727935:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789123203.727940:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbb200, rc 0) 00000100:00100000:3.0:1789123203.728047:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+32:11572:x1876031364469504:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 510us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123203.728054:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 148 00000100:00100000:1.0:1789123203.730906:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123203.730992:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364469760 00000100:00100000:2.0:1789123203.731004:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364469760 00000100:00100000:2.0:1789123203.731082:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 39 00000100:00100000:2.0:1789123203.731094:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340493a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+32:11572:x1876031364469760:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:2.0:1789123203.731390:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340493a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+33:11572:x1876031364469760:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 297us (496us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1789123203.731399:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 39 00000100:00100000:0.0:1789123203.800396:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123203.800533:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364470016 00000100:00100000:2.0:1789123203.800542:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364470016 00000100:00100000:2.0:1789123203.800672:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 149 00000100:00100000:2.0:1789123203.800682:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d329e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+33:11582:x1876031364470016:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1789123203.800705:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123203.800724:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9257d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f78e expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123203.800826:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1789123203.800932:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9257d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f78e expref: 35 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123203.800962:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34226c1a00) 00010000:00010000:2.0:1789123203.800965:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789123203.800970:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9257d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f78e expref: 35 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123203.800985:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80a400, rc 0) 00000100:00100000:2.0:1789123203.801033:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d329e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+34:11582:x1876031364470016:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 353us (647us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1789123203.801040:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 149 00000100:00100000:0.0:1789123203.805309:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123203.805385:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364470144 00000100:00100000:1.0:1789123203.805399:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364470144 00000100:00100000:1.0:1789123203.805474:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 150 00000100:00100000:1.0:1789123203.805485:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d329680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+34:11582:x1876031364470144:12345-192.168.206.30@tcp:34:lfs.0 00010000:00010000:1.0:1789123203.805567:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc9258b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.805584:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc9258b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.805596:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc9258b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.805613:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc92592 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.805620:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc92592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.805651:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc92592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.805747:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92599 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.805757:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92599 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.805786:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92599 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789123203.805839:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92599 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.805854:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc9258b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.805860:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc9258b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.805866:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc9258b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.805872:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33000 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123203.805878:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc9258b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.805885:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc9258b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.805895:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:1.0:1789123203.805898:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123203.805902:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc9258b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.805908:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc9258b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.805929:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc92592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.805946:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc92592 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.805952:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc92592 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.805956:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32200 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123203.805959:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc92592 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.805965:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc92592 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.805973:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f340534d700) 00010000:00010000:1.0:1789123203.805975:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123203.805978:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc92592 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.805983:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc92592 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.805996:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92599 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.806002:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92599 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.806007:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92599 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.806011:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32c00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123203.806019:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92599 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.806025:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92599 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.806032:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f3411751200) 00010000:00010000:1.0:1789123203.806034:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123203.806037:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92599 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.806043:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92599 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123203.806121:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d329680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+34:11582:x1876031364470144:12345-192.168.206.30@tcp:34:lfs.0 Request processed in 638us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123203.806128:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 150 00000100:00100000:1.0:1789123203.814975:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123203.815277:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364470400 00000100:00100000:2.0:1789123203.815291:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364470400 00000100:00100000:2.0:1789123203.815416:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 40 00000100:00100000:2.0:1789123203.815429:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3404938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+34:11582:x1876031364470400:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:2.0:1789123203.815849:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3404938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+35:11582:x1876031364470400:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 421us (886us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1789123203.815860:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 40 00000100:00100000:0.0:1789123203.850945:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123203.854314:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364470656 00000100:00100000:1.0:1789123203.854334:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364470656 00000100:00100000:1.0:1789123203.854430:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 151 00000100:00100000:1.0:1789123203.854443:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+35:11585:x1876031364470656:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1789123203.854475:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123203.854502:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc925a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f795 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.854598:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc925a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.855345:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc925a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.855380:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc925a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.855401:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc925ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.855409:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc925ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.855416:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc925ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.855578:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc925b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.855588:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc925b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.855596:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc925b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123203.856285:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789123203.856430:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc925a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.856438:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc925a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.856445:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc925a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.856451:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32200 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123203.856465:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc925a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.856474:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc925a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.856489:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:1.0:1789123203.856493:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123203.856498:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc925a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.856506:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc925a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.856521:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc925ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.856527:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc925ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.856533:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc925ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.856539:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33000 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123203.856542:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc925ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.856548:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc925ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.856556:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f340534d700) 00010000:00010000:1.0:1789123203.856558:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123203.856568:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc925ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.856574:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc925ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.857495:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc925a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f795 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.857520:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc925b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f795 expref: 37 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123203.857529:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f3411751200) 00010000:00010000:1.0:1789123203.857532:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789123203.857536:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd33400, rc 0) 00000100:00100000:1.0:1789123203.857658:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+37:11585:x1876031364470656:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 3215us (6726us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1789123203.857668:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 151 00000100:00100000:0.0:1789123203.866434:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123203.866533:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364470784 00000100:00100000:3.0:1789123203.866546:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364470784 00000100:00100000:3.0:1789123203.866655:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 152 00000100:00100000:3.0:1789123203.866668:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+37:11585:x1876031364470784:12345-192.168.206.30@tcp:54:lfs.0 00010000:00010000:3.0:1789123203.866757:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc925c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.866779:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc925c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.866794:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc925c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.866827:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc925c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.866834:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc925c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.866842:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc925c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.866849:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbb800 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123203.866866:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc925c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.866875:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc925c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.866890:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f3411751200) 00010000:00010000:3.0:1789123203.866894:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789123203.866900:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc925c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123203.866908:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc925c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123203.867000:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+37:11585:x1876031364470784:12345-192.168.206.30@tcp:54:lfs.0 Request processed in 334us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123203.867008:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 152 00000100:00100000:0.0:1789123203.871708:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123203.871807:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364471040 00000100:00100000:1.0:1789123203.871821:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364471040 00000100:00100000:1.0:1789123203.871890:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 41 00000100:00100000:1.0:1789123203.871902:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+37:11585:x1876031364471040:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:1.0:1789123203.872207:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+38:11585:x1876031364471040:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 305us (514us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1789123203.872216:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 41 00000100:00100000:0.0:1789123204.000674:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123204.000716:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123204.001028:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364471168 00000100:00100000:2.0:1789123204.001044:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364471168 00000100:00100000:2.0:1789123204.001130:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 321 00000100:00100000:2.0:1789123204.001142:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+13:2355:x1876031364471168:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1789123204.001244:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+13:2355:x1876031364471168:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 104us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123204.001253:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 321 00000100:00100000:0.0:1789123204.002261:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123204.002352:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364471296 00000100:00100000:1.0:1789123204.002362:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364471296 00000100:00100000:1.0:1789123204.002450:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 80 00000100:00100000:1.0:1789123204.002461:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2355:x1876031364471296:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123204.002547:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2355:x1876031364471296:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 88us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123204.002555:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 80 00000100:00100000:3.0:1789123204.002758:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364471424 00000100:00100000:3.0:1789123204.002768:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364471424 00000100:00100000:3.0:1789123204.002821:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 159 00000100:00100000:3.0:1789123204.002831:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2355:x1876031364471424:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1789123204.002901:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2355:x1876031364471424:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 71us (2184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123204.002909:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 159 00000100:00080000:2.0:1789123204.004698:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789123204.192408:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123204.195867:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364471680 00000100:00100000:3.0:1789123204.195887:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364471680 00000100:00100000:3.0:1789123204.195982:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 153 00000100:00100000:3.0:1789123204.195995:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+38:11617:x1876031364471680:12345-192.168.206.30@tcp:101:cat.0 00010000:00010000:3.0:1789123204.196028:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123204.201463:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc925ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f79c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123204.201667:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc925d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123204.201695:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc925d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123204.201710:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc925d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123204.201725:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789123204.201906:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc925ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f79c expref: 41 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123204.201929:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc925d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f79c expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123204.201939:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f3411751200) 00010000:00010000:3.0:1789123204.201942:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789123204.201946:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbbc00, rc 0) 00000100:00100000:3.0:1789123204.202037:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+40:11617:x1876031364471680:12345-192.168.206.30@tcp:101:cat.0 Request processed in 6043us (9641us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1789123204.202048:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 153 00000100:00100000:1.0:1789123204.208199:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123204.208321:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123204.208807:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364472064 00000100:00100000:3.0:1789123204.208820:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364472064 00000100:00100000:3.0:1789123204.208897:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 11 00000100:00100000:3.0:1789123204.208909:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d552c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+40:2353:x1876031364472064:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789123204.208943:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123204.208976:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc925d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f79c expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123204.208999:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f3411751200) 00010000:00010000:3.0:1789123204.209005:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789123204.209087:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d552c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+39:2353:x1876031364472064:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 180us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123204.209096:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 11 00000100:00100000:2.0:1789123204.214765:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364471936 00000100:00100000:2.0:1789123204.214784:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364471936 00000100:00100000:2.0:1789123204.214876:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 42 00000100:00100000:2.0:1789123204.214887:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d55e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+39:11617:x1876031364471936:12345-192.168.206.30@tcp:35:cat.0 00000100:00100000:2.0:1789123204.216778:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d55e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+40:11617:x1876031364471936:12345-192.168.206.30@tcp:35:cat.0 Request processed in 1879us (8591us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1789123204.216793:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 42 00000100:00100000:1.0:1789123204.324620:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123204.327489:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364472320 00000100:00100000:3.0:1789123204.327510:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364472320 00000100:00100000:2.0:1789123204.332433:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 154 00000100:00100000:2.0:1789123204.332453:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+40:11623:x1876031364472320:12345-192.168.206.30@tcp:101:dd.0 00010000:00010000:2.0:1789123204.332486:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123204.332490:0:7640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789123204.332527:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92537 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f772 expref: 40 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.332551:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:2.0:1789123204.332558:0:7640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789123204.332576:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc925df lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f7a3 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.332756:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc925e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.332772:0:7640:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc925b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f795 expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.332783:0:7640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc925e6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.332845:0:7640:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc925b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f795 expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.332862:0:7640:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc925b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f795 expref: 40 pid: 5841 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123204.332879:0:7640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1876031381254272:192.168.206.30@tcp:104: 00000100:00100000:2.0:1789123204.333015:0:7640:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f342d734d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789123204.338409:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123204.338543:0:7640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1876031381254272:192.168.206.30@tcp:104: 00010000:00010000:2.0:1789123204.338578:0:7640:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc925e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123204.338834:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364472448 00000100:00100000:0.0:1789123204.338843:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364472448 00010000:00010000:0.0:1789123204.338895:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc925b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f795 expref: 41 pid: 5841 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123204.338931:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 69 00000100:00100000:0.0:1789123204.338942:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f50b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+41:2354:x1876031364472448:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789123204.338961:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123204.338969:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc925b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f795 expref: 41 pid: 5841 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123204.338982:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc925b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f795 expref: 41 pid: 5841 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123204.339013:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc925b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f795 expref: 41 pid: 5841 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123204.339031:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f3411751200) 00010000:00010000:0.0:1789123204.339037:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc925e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123204.339048:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc925e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123204.339059:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc925e6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123204.339102:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123204.339166:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f50b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+40:2354:x1876031364472448:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 225us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123204.339190:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 69 00010000:00010000:2.0:1789123204.339329:0:7640:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc925e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.339338:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc925e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123204.339364:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789123204.339565:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc925df lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7a3 expref: 41 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.339584:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc925e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7a3 expref: 40 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.339593:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f3411751200) 00010000:00010000:2.0:1789123204.339597:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789123204.339606:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80b600, rc 0) 00000100:00100000:2.0:1789123204.339692:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+40:11623:x1876031364472320:12345-192.168.206.30@tcp:101:dd.0 Request processed in 7235us (15080us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1789123204.339700:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 154 00000100:00100000:3.0:1789123204.344599:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123204.345553:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364472704 00000100:00100000:1.0:1789123204.345572:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364472704 00000100:00100000:1.0:1789123204.345830:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 155 00000100:00100000:1.0:1789123204.345843:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f51a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+40:11623:x1876031364472704:12345-192.168.206.30@tcp:36:dd.0 00010000:00010000:1.0:1789123204.346193:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc925f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123204.346906:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc925f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123204.346941:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc925f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789123204.347135:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1789123204.347186:0:5840:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000005a5c76c8 reply state 000000007e9e9551 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc925f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123204.347196:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789123204.347332:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f51a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+43:11623:x1876031364472704:12345-192.168.206.30@tcp:36:dd.0 Request processed in 1488us (2746us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1789123204.347341:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 155 00000020:00080000:1.0:1789123204.347349:0:5840:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789123204.358240:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc925f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123204.358263:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc925f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123204.358271:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc925f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123204.358278:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33c00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123204.358283:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc925f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123204.358300:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc925f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123204.358323:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f3411751200) 00010000:00010000:3.0:1789123204.358342:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123204.358350:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc925f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123204.358357:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc925f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123204.612910:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789123204.698993:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:3.0:1789123204.699018:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:0.0:1789123204.775852:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123204.776961:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364472832 00000100:00100000:1.0:1789123204.776997:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364472832 00000100:00100000:1.0:1789123204.777102:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 156 00000100:00100000:1.0:1789123204.777115:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+42:11637:x1876031364472832:12345-192.168.206.30@tcp:101:stat.0 00010000:00010000:1.0:1789123204.777158:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123204.777194:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc925fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f7aa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123204.777278:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc92602 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123204.777306:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc92602 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123204.777325:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc92602 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123204.777342:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92609 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123204.777350:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123204.777357:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123204.777475:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92610 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123204.777488:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc925e6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7a3 expref: 43 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123204.777497:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92610 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123204.777546:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc925e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7a3 expref: 43 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123204.777560:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc925e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7a3 expref: 43 pid: 7640 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123204.777576:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876031381254400:192.168.206.30@tcp:104: 00000100:00100000:1.0:1789123204.777763:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3418b9b300 going to sleep for 11 seconds 00000100:00100000:0.0:1789123204.781866:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123204.782001:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364473088 00000100:00100000:3.0:1789123204.782014:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364473088 00000100:00100000:3.0:1789123204.782096:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 43 00000100:00100000:3.0:1789123204.782108:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+44:6051:x1876031364473088:12345-192.168.206.30@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789123204.782560:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+45:6051:x1876031364473088:12345-192.168.206.30@tcp:35:ldlm_bl.0 Request processed in 452us (707us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1789123204.782569:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 43 00000100:00100000:1.0:1789123204.783808:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876031381254400:192.168.206.30@tcp:104: 00010000:00010000:1.0:1789123204.783847:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92610 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123204.787461:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123204.787688:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364473216 00000100:00100000:1.0:1789123204.787711:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364473216 00010000:00010000:1.0:1789123204.787769:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc925e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7a3 expref: 45 pid: 7640 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123204.787981:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 70 00000100:00100000:1.0:1789123204.787993:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f50780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+45:2354:x1876031364473216:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789123204.788014:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123204.788034:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc925e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7a3 expref: 45 pid: 7640 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123204.788048:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc925e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7a3 expref: 45 pid: 7640 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123204.788099:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc925e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7a3 expref: 45 pid: 7640 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123204.788118:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f3411751200) 00010000:00010000:1.0:1789123204.788125:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92610 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123204.788148:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92610 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123204.788158:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92610 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123204.788197:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789123204.788271:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f50780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+44:2354:x1876031364473216:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 279us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123204.788280:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 70 00010000:00010000:0.0:1789123204.788414:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92610 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123204.788424:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92610 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123204.788482:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789123204.788488:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789123204.788517:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92610 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123204.788532:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92610 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123204.788544:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc92602 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123204.788551:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc92602 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123204.788558:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc92602 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123204.788564:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33800 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123204.788569:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc92602 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123204.788589:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc92602 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123204.788601:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:0.0:1789123204.788604:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123204.788608:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc92602 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123204.788615:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc92602 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123204.788664:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123204.788671:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92609 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123204.788678:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92609 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123204.788683:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32a00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123204.788686:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92609 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123204.788692:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92609 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123204.788699:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f340534d500) 00010000:00010000:0.0:1789123204.788702:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123204.788705:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92609 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123204.788722:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92609 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123204.788769:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc925fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7aa expref: 44 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123204.788784:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92610 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7aa expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123204.788805:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f3411751200) 00010000:00010000:0.0:1789123204.788808:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789123204.788810:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd32400, rc 0) 00000100:00100000:0.0:1789123204.788844:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+43:11637:x1876031364472832:12345-192.168.206.30@tcp:101:stat.0 Request processed in 11732us (13008us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123204.788851:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 156 00000100:00100000:0.0:1789123204.872478:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123204.872857:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364473472 00000100:00100000:3.0:1789123204.872871:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364473472 00000100:00100000:3.0:1789123204.872943:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 157 00000100:00100000:3.0:1789123204.872955:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+43:11643:x1876031364473472:12345-192.168.206.30@tcp:36:truncate.0 00010000:00010000:3.0:1789123204.873162:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123204.873199:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92610 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7aa expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123204.873224:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f3411751200) 00010000:00010000:3.0:1789123204.873231:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789123204.873518:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92617 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123204.873549:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92617 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123204.873561:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92617 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789123204.875160:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1789123204.875265:0:5842:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e518e348 reply state 000000008c48c025 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92617 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123204.875280:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789123204.875458:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+45:11643:x1876031364473472:12345-192.168.206.30@tcp:36:truncate.0 Request processed in 2501us (2990us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1789123204.875469:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 157 00000020:00080000:3.0:1789123204.875476:0:5842:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789123204.885404:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92617 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.885428:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92617 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.885438:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92617 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.885445:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbbc00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123204.885451:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92617 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.885460:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92617 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.885482:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f3411751200) 00010000:00010000:2.0:1789123204.885485:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123204.885491:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92617 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.885498:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92617 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123204.988381:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123204.988605:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364473600 00000100:00100000:2.0:1789123204.988620:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364473600 00000100:00100000:2.0:1789123204.988770:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 158 00000100:00100000:2.0:1789123204.988783:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+44:11657:x1876031364473600:12345-192.168.206.30@tcp:101:stat.0 00010000:00010000:2.0:1789123204.988839:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123204.988867:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9261e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f7b1 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.988954:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92625 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.988972:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92625 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.988986:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92625 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.989003:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9262c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.989010:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9262c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.989128:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9262c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.989259:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92633 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.989267:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.989275:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123204.989331:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1789123204.989343:0:7640:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789123204.989374:0:7640:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.989388:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.989397:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92625 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.989403:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92625 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.989410:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92625 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.989416:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80b600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123204.989421:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92625 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.989429:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92625 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.989442:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:2.0:1789123204.989445:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123204.989450:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92625 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.989457:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92625 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.989472:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9262c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.989489:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9262c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.989495:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9262c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.989500:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80ae00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123204.989504:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9262c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.989510:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9262c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.989519:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f34232f7b00) 00010000:00010000:2.0:1789123204.989522:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123204.989934:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9262c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.989944:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9262c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.989991:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc9261e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7b1 expref: 46 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.990006:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92633 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7b1 expref: 45 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123204.990014:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f3411751200) 00010000:00010000:2.0:1789123204.990080:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789123204.990091:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80bc00, rc 0) 00000100:00100000:2.0:1789123204.990260:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+45:11657:x1876031364473600:12345-192.168.206.30@tcp:101:stat.0 Request processed in 1479us (1891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123204.990270:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 158 00000100:00100000:3.0:1789123205.097518:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123205.098213:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364473856 00000100:00100000:1.0:1789123205.098227:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364473856 00000100:00100000:1.0:1789123205.098329:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 159 00000100:00100000:1.0:1789123205.098343:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+45:11667:x1876031364473856:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1789123205.098371:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123205.098412:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9263a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f7b8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123205.098580:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1789123205.098784:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9263a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7b8 expref: 47 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789123205.098897:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789123205.099235:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34226c1a00) 00010000:00010000:1.0:1789123205.099238:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789123205.099246:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9263a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7b8 expref: 47 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123205.099263:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd32e00, rc 0) 00000100:00100000:1.0:1789123205.099512:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+46:11667:x1876031364473856:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 1171us (2008us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1789123205.100019:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 159 00000100:00100000:1.0:1789123205.107553:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123205.107936:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364474112 00000100:00100000:3.0:1789123205.107949:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364474112 00000100:00100000:3.0:1789123205.108100:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 44 00000100:00100000:3.0:1789123205.108114:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427abf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+46:11667:x1876031364474112:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:3.0:1789123205.109051:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427abf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+47:11667:x1876031364474112:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 934us (1508us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1789123205.109071:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 44 00000100:00100000:0.0:1789123205.242403:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123205.242517:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364474368 00000100:00100000:1.0:1789123205.242529:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364474368 00000100:00100000:1.0:1789123205.242872:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 160 00000100:00100000:1.0:1789123205.242887:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+47:11673:x1876031364474368:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:1.0:1789123205.242920:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123205.242948:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92648 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f7bf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123205.243083:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc9264f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123205.243100:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92633 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7b1 expref: 48 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123205.243111:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc9264f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123205.243170:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92633 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7b1 expref: 48 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123205.243196:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92633 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7b1 expref: 48 pid: 7640 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123205.243221:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409d55a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876031381254528:192.168.206.30@tcp:104: 00000100:00100000:1.0:1789123205.243343:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3418b9b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789123205.252733:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409d55a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876031381254528:192.168.206.30@tcp:104: 00010000:00010000:0.0:1789123205.252778:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc9264f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123205.254559:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123205.258391:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364474496 00000100:00100000:1.0:1789123205.258414:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364474496 00010000:00010000:1.0:1789123205.258487:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92633 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7b1 expref: 49 pid: 7640 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123205.258826:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 71 00000100:00100000:1.0:1789123205.258840:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3406284450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+49:2355:x1876031364474496:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789123205.258860:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123205.258870:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92633 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7b1 expref: 49 pid: 7640 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123205.258885:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92633 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7b1 expref: 49 pid: 7640 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123205.258914:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92633 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7b1 expref: 49 pid: 7640 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123205.258935:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f3411751200) 00010000:00010000:1.0:1789123205.258956:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc9264f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123205.258967:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc9264f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123205.258976:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc9264f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123205.259017:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789123205.259120:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3406284450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+48:2355:x1876031364474496:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 284us (4574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123205.259129:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 71 00010000:00010000:0.0:1789123205.260148:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc9264f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123205.260162:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc9264f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123205.260217:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1789123205.260426:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92648 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7bf expref: 49 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123205.260446:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc9264f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7bf expref: 48 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123205.260455:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f3411751200) 00010000:00010000:0.0:1789123205.260458:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789123205.260461:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd33800, rc 0) 00000100:00100000:0.0:1789123205.260533:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+48:11673:x1876031364474368:12345-192.168.206.30@tcp:101:bash.0 Request processed in 17650us (18144us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1789123205.260541:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 160 00000100:00100000:0.0:1789123205.265686:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123205.265944:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364474752 00000100:00100000:3.0:1789123205.265956:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364474752 00000100:00100000:3.0:1789123205.266042:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 161 00000100:00100000:3.0:1789123205.266054:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+48:11673:x1876031364474752:12345-192.168.206.30@tcp:36:bash.0 00010000:00010000:3.0:1789123205.266454:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc9265d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123205.266476:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc9265d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123205.266490:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc9265d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789123205.266551:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1789123205.266577:0:5842:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000633bb0ca reply state 00000000d378d9c9 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc9265d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123205.266604:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789123205.267505:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+51:11673:x1876031364474752:12345-192.168.206.30@tcp:36:bash.0 Request processed in 1444us (1824us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1789123205.267517:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 161 00000020:00080000:3.0:1789123205.267524:0:5842:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789123205.271575:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc9265d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123205.271615:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc9265d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123205.271856:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc9265d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123205.271867:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fba400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123205.271872:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc9265d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123205.271881:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc9265d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123205.271920:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f3411751200) 00010000:00010000:3.0:1789123205.271923:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123205.271929:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc9265d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123205.271935:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc9265d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123205.281585:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123205.281963:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364474880 00000100:00100000:2.0:1789123205.281976:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364474880 00000100:00100000:2.0:1789123205.282053:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 162 00000100:00100000:2.0:1789123205.282065:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+50:11673:x1876031364474880:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:2.0:1789123205.282097:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123205.282128:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92664 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f7c6 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.282251:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc9266b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.282269:0:7640:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc9264f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7bf expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.282279:0:7640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc9266b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.282337:0:7640:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc9264f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7bf expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.282354:0:7640:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc9264f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7bf expref: 51 pid: 5841 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123205.282371:0:7640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1876031381254656:192.168.206.30@tcp:104: 00000100:00100000:2.0:1789123205.282510:0:7640:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f342d7349c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789123205.287217:0:7640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1876031381254656:192.168.206.30@tcp:104: 00010000:00010000:0.0:1789123205.287257:0:7640:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc9266b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123205.287426:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123205.287666:0:11614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364475008 00000100:00100000:1.0:1789123205.287676:0:11614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364475008 00010000:00010000:1.0:1789123205.287739:0:11614:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc9264f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7bf expref: 52 pid: 5841 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123205.287780:0:11614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 72 00000100:00100000:1.0:1789123205.287791:0:11614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+52:2355:x1876031364475008:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789123205.287810:0:11614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123205.287817:0:11614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc9264f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7bf expref: 52 pid: 5841 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123205.287833:0:11614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc9264f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7bf expref: 52 pid: 5841 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123205.287861:0:11614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc9264f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7bf expref: 52 pid: 5841 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123205.287900:0:11614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f3411751200) 00010000:00010000:1.0:1789123205.287905:0:11614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc9266b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123205.287917:0:11614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc9266b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123205.287926:0:11614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc9266b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123205.287961:0:11614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789123205.288031:0:11614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+51:2355:x1876031364475008:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 242us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123205.288040:0:11614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 72 00010000:00010000:0.0:1789123205.288398:0:7640:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc9266b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123205.288409:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc9266b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123205.288467:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789123205.288473:0:7640:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789123205.288509:0:7640:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc9266b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123205.288551:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92664 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7c6 expref: 51 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123205.288569:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc9266b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7c6 expref: 50 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123205.288578:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f3411751200) 00010000:00010000:0.0:1789123205.288581:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789123205.288584:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80ba00, rc 0) 00000100:00100000:0.0:1789123205.288661:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+50:11673:x1876031364474880:12345-192.168.206.30@tcp:101:bash.0 Request processed in 6598us (7090us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123205.288668:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 162 00000100:00100000:0.0:1789123205.307956:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123205.308073:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364475264 00000100:00100000:2.0:1789123205.308086:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364475264 00000100:00100000:2.0:1789123205.308218:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 45 00000100:00100000:2.0:1789123205.308231:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+50:11673:x1876031364475264:12345-192.168.206.30@tcp:35:bash.0 00000100:00100000:2.0:1789123205.308819:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+51:11673:x1876031364475264:12345-192.168.206.30@tcp:35:bash.0 Request processed in 588us (875us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1789123205.308828:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 45 00000100:00100000:2.0:1789123205.426055:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123205.426218:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364475520 00000100:00100000:3.0:1789123205.426231:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364475520 00000100:00100000:3.0:1789123205.426311:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 163 00000100:00100000:3.0:1789123205.426323:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c304f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+51:11683:x1876031364475520:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:3.0:1789123205.426354:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123205.426380:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc92672 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f7cd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123205.426525:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1789123205.427575:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc92672 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7cd expref: 53 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123205.427802:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34226c1a00) 00010000:00010000:0.0:1789123205.427807:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789123205.427814:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc92672 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7cd expref: 53 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123205.427832:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fba400, rc 0) 00000100:00100000:0.0:1789123205.427978:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c304f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+52:11683:x1876031364475520:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 1656us (1936us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1789123205.427987:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 163 00000100:00100000:3.0:1789123205.434684:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123205.434787:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364475648 00000100:00100000:2.0:1789123205.434800:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364475648 00000100:00100000:2.0:1789123205.434868:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 164 00000100:00100000:2.0:1789123205.434880:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+52:11683:x1876031364475648:12345-192.168.206.30@tcp:34:lfs.0 00010000:00010000:2.0:1789123205.434982:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc92680 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.435003:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc92680 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.435017:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc92680 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.435034:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc92687 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.435041:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc92687 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.435086:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc92687 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.435230:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc9268e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.435240:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc9268e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.435248:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc9268e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789123205.435313:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc9268e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.435328:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc92680 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.435335:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc92680 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.435342:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc92680 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.435349:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80ac00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123205.435353:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc92680 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.435361:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc92680 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.435375:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:2.0:1789123205.435384:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123205.435390:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc92680 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.435397:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc92680 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.435413:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc92687 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.435419:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc92687 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.435424:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc92687 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.435429:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80b400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123205.435432:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc92687 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.435437:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc92687 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.435445:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f34232f7b00) 00010000:00010000:2.0:1789123205.435448:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123205.435451:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc92687 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.435458:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc92687 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.435474:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc9268e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.435487:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc9268e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.435492:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc9268e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.435497:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80b600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123205.435500:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc9268e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.435506:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc9268e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.435514:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f3411751200) 00010000:00010000:2.0:1789123205.435517:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123205.435520:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc9268e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.435525:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc9268e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123205.436941:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+52:11683:x1876031364475648:12345-192.168.206.30@tcp:34:lfs.0 Request processed in 2050us (2258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123205.436958:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 164 00000100:00100000:3.0:1789123205.439956:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123205.440101:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364475904 00000100:00100000:1.0:1789123205.440115:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364475904 00000100:00100000:1.0:1789123205.440197:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 46 00000100:00100000:1.0:1789123205.440436:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+52:11683:x1876031364475904:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:1.0:1789123205.440977:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+53:11683:x1876031364475904:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 547us (1035us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1789123205.440987:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 46 00000100:00100000:1.0:1789123205.492577:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123205.493481:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364476160 00000100:00100000:2.0:1789123205.493497:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364476160 00000100:00100000:2.0:1789123205.493968:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 165 00000100:00100000:2.0:1789123205.493983:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+53:11686:x1876031364476160:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1789123205.494016:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123205.494056:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92695 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f7d4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.494507:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc9269c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.494539:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc9269c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.494556:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc9269c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.494576:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc926a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.494583:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc926a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.494607:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc926a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.494844:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc926aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.494854:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc926aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.494861:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc926aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123205.494874:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789123205.495003:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc9269c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.495024:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc9269c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.495032:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc9269c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.495039:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80b400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123205.495044:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc9269c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.495051:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc9269c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.495374:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:2.0:1789123205.495379:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123205.495386:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc9269c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.495395:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc9269c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.495410:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc926a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.495418:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc926a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.495424:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc926a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.495430:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80ac00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123205.495441:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc926a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.495448:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc926a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.495457:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f34232f7b00) 00010000:00010000:2.0:1789123205.495460:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123205.495463:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc926a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.495469:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc926a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.495585:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92695 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7d4 expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.495602:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc926aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7d4 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.495611:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f3411751200) 00010000:00010000:2.0:1789123205.495614:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789123205.495617:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80a200, rc 0) 00000100:00100000:2.0:1789123205.496120:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+55:11686:x1876031364476160:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 2138us (3555us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1789123205.496131:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 165 00000100:00100000:1.0:1789123205.502329:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123205.503331:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123205.504392:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364476416 00000100:00100000:0.0:1789123205.504409:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364476416 00000100:00100000:0.0:1789123205.504503:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 12 00000100:00100000:0.0:1789123205.504516:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d55e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+55:2353:x1876031364476416:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789123205.504552:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123205.504607:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc926aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7d4 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123205.504653:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f3411751200) 00010000:00010000:0.0:1789123205.504662:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123205.504931:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d55e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+54:2353:x1876031364476416:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 416us (1605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123205.504939:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 12 00000100:00100000:2.0:1789123205.506932:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364476288 00000100:00100000:2.0:1789123205.506950:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364476288 00000100:00100000:2.0:1789123205.507028:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 166 00000100:00100000:2.0:1789123205.507040:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d55a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+54:11686:x1876031364476288:12345-192.168.206.30@tcp:54:lfs.0 00010000:00010000:2.0:1789123205.507147:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc926b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.507169:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc926b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.507319:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc926b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.507356:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc926b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.507364:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc926b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.507372:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc926b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.507379:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123205.507384:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc926b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.507393:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc926b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.507406:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f3411751200) 00010000:00010000:2.0:1789123205.507410:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789123205.507415:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc926b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.507423:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc926b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123205.507525:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d55a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+54:11686:x1876031364476288:12345-192.168.206.30@tcp:54:lfs.0 Request processed in 487us (5345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123205.508158:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 166 00000100:00100000:1.0:1789123205.515562:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123205.515900:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364476672 00000100:00100000:3.0:1789123205.515915:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364476672 00000100:00100000:3.0:1789123205.515991:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 47 00000100:00100000:3.0:1789123205.516004:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d32a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+54:11686:x1876031364476672:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:3.0:1789123205.517365:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d32a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+55:11686:x1876031364476672:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 1352us (1807us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1789123205.517380:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 47 00010000:00010000:3.0:1789123205.637565:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123205.725618:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123205.725953:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364476928 00000100:00100000:0.0:1789123205.725966:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364476928 00000100:00100000:0.0:1789123205.726038:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 167 00000100:00100000:0.0:1789123205.726050:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+55:11704:x1876031364476928:12345-192.168.206.30@tcp:101:cat.0 00010000:00010000:0.0:1789123205.726081:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123205.726110:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc926bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f7db expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123205.726263:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc926c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123205.726282:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc926c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123205.726311:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc926c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123205.726341:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789123205.726514:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc926bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7db expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123205.726549:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc926c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7db expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123205.726559:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f3411751200) 00010000:00010000:0.0:1789123205.726562:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789123205.726567:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53400, rc 0) 00000100:00100000:0.0:1789123205.726706:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+57:11704:x1876031364476928:12345-192.168.206.30@tcp:101:cat.0 Request processed in 657us (1102us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1789123205.726715:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 167 00000100:00100000:1.0:1789123205.775528:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123205.775673:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364477056 00000100:00100000:0.0:1789123205.775688:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364477056 00000100:00100000:0.0:1789123205.775769:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 168 00000100:00100000:0.0:1789123205.775781:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+57:11705:x1876031364477056:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:0.0:1789123205.775814:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123205.775843:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc926d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f7e2 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123205.775927:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc926db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123205.775944:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc926db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123205.775970:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc926db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123205.776041:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1789123205.776045:0:7640:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789123205.776070:0:7640:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc926db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123205.776101:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc926d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7e2 expref: 59 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123205.776122:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc926db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7e2 expref: 58 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123205.776132:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:0.0:1789123205.776135:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789123205.776139:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53000, rc 0) 00000100:00100000:0.0:1789123205.776469:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+58:11705:x1876031364477056:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 690us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123205.776478:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 168 00000100:00100000:1.0:1789123205.788968:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123205.789184:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364477440 00000100:00100000:2.0:1789123205.789326:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364477440 00000100:00100000:2.0:1789123205.789397:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 48 00000100:00100000:2.0:1789123205.789410:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+58:11705:x1876031364477440:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:3.0:1789123205.790933:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+59:11705:x1876031364477440:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 1513us (2192us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1789123205.790948:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 48 00000100:00100000:1.0:1789123205.805249:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123205.805344:0:11614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364477568 00000100:00100000:2.0:1789123205.805356:0:11614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364477568 00000100:00100000:2.0:1789123205.805494:0:11614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 13 00000100:00100000:2.0:1789123205.805508:0:11614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435671e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+59:11705:x1876031364477568:12345-192.168.206.30@tcp:103:lfs.0 00010000:00010000:2.0:1789123205.805540:0:11614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789123205.805574:0:11614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc9266b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7c6 expref: 59 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.805611:0:11614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc926c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7db expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.805688:0:11614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc92576 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f787 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.805702:0:11614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f3411751200) 00010000:00010000:2.0:1789123205.805714:0:11614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123205.805796:0:11614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435671e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+56:11705:x1876031364477568:12345-192.168.206.30@tcp:103:lfs.0 Request processed in 292us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123205.806359:0:11614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 13 00000100:00100000:1.0:1789123205.816573:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123205.826934:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364477696 00000100:00100000:2.0:1789123205.826956:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364477696 00000100:00100000:2.0:1789123205.827109:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 169 00000100:00100000:2.0:1789123205.827122:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435670b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+56:11705:x1876031364477696:12345-192.168.206.30@tcp:58:lfs.0 00010000:00010000:2.0:1789123205.827320:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc926e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.827340:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc926e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.827353:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc926e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789123205.827608:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1789123205.827788:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435670b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+56:11705:x1876031364477696:12345-192.168.206.30@tcp:58:lfs.0 Request processed in 666us (11228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123205.827797:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 169 00000100:00100000:0.0:1789123205.863156:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123205.863311:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364477824 00000100:00100000:2.0:1789123205.863324:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364477824 00000100:00100000:2.0:1789123205.863403:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 170 00000100:00100000:2.0:1789123205.863415:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+56:11707:x1876031364477824:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1789123205.863443:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123205.863470:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc926e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f7e9 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.863574:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc926f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.863617:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc926f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.863686:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc926f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.863706:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc926f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.863714:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc926f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123205.863721:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc926f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123205.865441:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc926fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123205.865467:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc926fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123205.865481:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc926fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123205.865548:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789123205.865554:0:7640:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789123205.865581:0:7640:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc926fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123205.865605:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc926fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123205.865617:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc926f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123205.865623:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc926f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123205.865765:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc926f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123205.865773:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80ac00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123205.865777:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc926f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123205.865996:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc926f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123205.866014:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:3.0:1789123205.866017:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123205.866023:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc926f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123205.866030:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc926f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123205.866047:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc926f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123205.866054:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc926f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123205.866059:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc926f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123205.866064:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80b400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123205.866067:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc926f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123205.866074:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc926f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123205.866082:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f34232f7900) 00010000:00010000:3.0:1789123205.866084:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123205.866099:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc926f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123205.866116:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc926f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123205.866175:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc926e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7e9 expref: 58 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123205.866192:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc926fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7e9 expref: 57 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123205.866977:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f34232f7b00) 00010000:00010000:3.0:1789123205.866984:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789123205.866989:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbb800, rc 0) 00000100:00100000:3.0:1789123205.867110:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+57:11707:x1876031364477824:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 3694us (3965us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123205.867120:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 170 00000100:00100000:1.0:1789123206.149941:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381254784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789123206.150042:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1789123206.150406:0:12081:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789123206.150412:0:12081:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789123206.150456:0:12081:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789123206.150462:0:12081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789123206.150599:0:12081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435673c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12081:1876031381254912:192.168.206.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789123206.150847:0:12667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381254784 00000100:00100000:2.0:1789123206.150855:0:12667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381254784 00000100:00100000:2.0:1789123206.150923:0:12667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789123206.150935:0:12667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435672d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381254784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789123206.150977:0:12667:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789123206.151073:0:12081:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3418b9b900 going to sleep for 11 seconds 00000100:00100000:0.0:1789123206.151926:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381255040:0@lo:400:kworker.0 00000100:00100000:2.0:1789123206.160575:0:12667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435672d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381254784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9625us (10516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123206.160607:0:12667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1789123206.160692:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789123206.166541:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123206.166585:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364477952 00000100:00100000:1.0:1789123206.166596:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364477952 00000100:00100000:1.0:1789123206.168835:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 171 00000100:00100000:1.0:1789123206.168859:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+58:11718:x1876031364477952:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789123206.168905:0:5842:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789123206.169091:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+58:11718:x1876031364477952:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 Request processed in 240us (2567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123206.169099:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 171 00000100:00100000:0.0:1789123206.172979:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3405de0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876031381255168:0@lo:400:kworker.0 00000100:00100000:0.0:1789123206.173063:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123206.173123:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3405de0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381255296:0@lo:400:kworker.0 00000100:00100000:0.0:1789123206.173155:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123206.173209:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789123206.173218:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3405de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381255424:0@lo:400:kworker.0 00000100:00100000:0.0:1789123206.173248:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123206.173296:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381255168 00000100:00100000:0.0:1789123206.173305:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381255168 00000100:00100000:0.0:1789123206.173359:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381255296 00000100:00100000:0.0:1789123206.173362:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381255296 00000100:00100000:0.0:1789123206.173398:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789123206.173407:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876031381255168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123206.173469:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876031381255168:12345-0@lo:400:kworker.0 Request processed in 62us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123206.173477:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789123206.173497:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789123206.173503:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409c983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381255296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123206.173535:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409c983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381255296:12345-0@lo:400:kworker.0 Request processed in 32us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123206.173541:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789123206.173564:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381255424 00000100:00100000:0.0:1789123206.173568:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381255424 00000100:00100000:0.0:1789123206.173597:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789123206.173604:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409c98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381255424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123206.173672:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409c98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381255424:12345-0@lo:400:kworker.0 Request processed in 56us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123206.173679:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789123206.173722:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3405de0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876031381255168:0@lo:400:kworker.0 00000100:00100000:0.0:1789123206.173752:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1789123206.173759:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1789123206.173786:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3405de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381255424:0@lo:400:kworker.0 00000100:00100000:0.0:1789123206.173798:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3405de0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381255296:0@lo:400:kworker.0 00000100:00100000:0.0:1789123206.173846:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381254784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789123206.173889:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123206.173925:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3405de12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876031381255552:0@lo:400:kworker.0 00000100:00100000:0.0:1789123206.173953:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123206.173970:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381255552 00000100:00100000:0.0:1789123206.173974:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381255552 00000100:00100000:0.0:1789123206.174000:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789123206.174006:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876031381255552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123206.174036:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876031381255552:12345-0@lo:400:kworker.0 Request processed in 30us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123206.174042:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789123206.174066:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3405de12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876031381255552:0@lo:400:kworker.0 00000100:00080000:3.0:1789123206.176933:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789123206.176945:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789123206.176972:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381255040 00000100:00100000:3.0:1789123206.176983:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381255040 00000100:00100000:3.0:1789123206.177044:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1789123206.177056:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3304:x1876031381255040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123206.177575:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381255040:0@lo:400:kworker.0 00000100:00100000:3.0:1789123206.179908:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3304:x1876031381255040:12345-0@lo:400:kworker.0 Request processed in 2838us (6003us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123206.179926:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1789123206.180114:0:12081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435673c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12081:1876031381254912:192.168.206.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789123206.185564:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123206.192222:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364478080 00000100:00100000:2.0:1789123206.192243:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364478080 00000100:00100000:2.0:1789123206.192345:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 172 00000100:00100000:2.0:1789123206.192358:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+57:11718:x1876031364478080:12345-192.168.206.30@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789123206.192468:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92705 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.192490:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92705 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.192504:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92705 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.200333:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9270c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.200360:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9270c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.200375:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9270c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.200416:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92713 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.200425:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92713 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.200432:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92713 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123206.200478:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789123206.200483:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789123206.200495:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92713 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.200507:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92705 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.200527:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92705 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.200533:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92705 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.200539:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80bc00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123206.200543:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92705 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.200550:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92705 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.200565:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f3411751e00) 00010000:00010000:2.0:1789123206.200568:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123206.200573:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92705 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.200580:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92705 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.200594:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9270c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.200600:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9270c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.200605:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9270c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.200610:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80ae00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123206.200620:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9270c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.200642:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9270c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.200651:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9f34232f7400) 00010000:00010000:2.0:1789123206.200653:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123206.200656:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9270c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.200662:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9270c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.200678:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92713 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.200685:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92713 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.200690:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92713 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.200695:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123206.200699:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92713 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.200706:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92713 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.200715:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f34232f7b00) 00010000:00010000:2.0:1789123206.200717:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123206.200727:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92713 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.200732:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92713 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123206.200837:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+57:11718:x1876031364478080:12345-192.168.206.30@tcp:34:lhsmtool_posix.0 Request processed in 8478us (15287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123206.200847:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 172 00000100:00100000:0.0:1789123206.213876:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123206.214418:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364478336 00000100:00100000:1.0:1789123206.214434:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364478336 00000100:00100000:1.0:1789123206.214511:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 173 00000100:00100000:1.0:1789123206.214523:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+57:11718:x1876031364478336:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789123206.214543:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123206.214579:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc9271a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f7f0 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.214730:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92721 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.214747:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92721 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.214760:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92721 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123206.214773:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789123206.214870:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92721 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.214878:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92721 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.214884:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92721 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.214889:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32a00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123206.214893:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92721 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.214901:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92721 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.214912:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f34232f7b00) 00010000:00010000:1.0:1789123206.214915:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789123206.214933:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92721 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.214950:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92721 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.214995:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc9271a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7f0 expref: 59 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.215006:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f3411751e00) 00010000:00010000:1.0:1789123206.215009:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789123206.215013:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc9271a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7f0 expref: 59 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.215023:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd32400, rc 0) 00000100:00100000:1.0:1789123206.215091:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+58:11718:x1876031364478336:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 570us (1233us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1789123206.215099:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 173 00000100:00100000:1.0:1789123206.221886:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123206.221985:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364478464 00000100:00100000:0.0:1789123206.222003:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364478464 00000100:00100000:0.0:1789123206.222193:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 174 00000100:00100000:0.0:1789123206.222210:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+58:11718:x1876031364478464:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789123206.222329:0:5841:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789123206.222505:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+58:11718:x1876031364478464:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 Request processed in 301us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123206.222515:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 174 00000100:00100000:0.0:1789123206.227305:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123206.230844:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364478720 00000100:00100000:3.0:1789123206.230859:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364478720 00000100:00100000:3.0:1789123206.230936:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 175 00000100:00100000:3.0:1789123206.230954:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+58:11718:x1876031364478720:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789123206.230975:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123206.230978:0:7640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789123206.231004:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc926db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7e2 expref: 58 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.231022:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:3.0:1789123206.231027:0:7640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789123206.231040:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc9272f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f7f7 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789123206.231488:0:7640:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1789123206.231697:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc92736 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.231711:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc92736 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.231721:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc92736 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.231775:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc9272f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7f7 expref: 60 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.231791:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc92736 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7f7 expref: 59 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.231799:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f3411751600) 00010000:00010000:3.0:1789123206.231802:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789123206.231815:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fba000, rc 0) 00000100:00100000:3.0:1789123206.231883:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+59:11718:x1876031364478720:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 930us (4584us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1789123206.231891:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 175 00000100:00100000:0.0:1789123206.249133:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123206.249250:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364478976 00000100:00100000:2.0:1789123206.249260:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364478976 00000100:00100000:2.0:1789123206.249332:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 176 00000100:00100000:2.0:1789123206.249342:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+59:11718:x1876031364478976:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789123206.249402:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123206.249432:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba000/0x7e1648d68fc92736 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7f7 expref: 59 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.249448:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f3411751600) 00010000:00010000:2.0:1789123206.249459:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789123206.249484:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92744 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.249497:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92744 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.249508:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92744 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.249521:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9274b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x3e1de18a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.249544:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9274b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3e1de18a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.249552:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9274b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3e1de18a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.249658:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92744 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.249666:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92744 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.249672:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92744 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.249677:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123206.249681:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92744 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.249688:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92744 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.249696:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:2.0:1789123206.249699:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123206.249703:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92744 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.249710:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92744 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.249719:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9274b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3e1de18a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.249731:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9274b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3e1de18a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.249738:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9274b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3e1de18a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.249743:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80ae00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123206.249746:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9274b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3e1de18a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.249752:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9274b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3e1de18a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.249760:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x3e1de18a (ffff9f34232f7400) 00010000:00010000:2.0:1789123206.249763:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123206.249766:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9274b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3e1de18a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.249772:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc9274b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3e1de18a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123206.249850:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+58:11718:x1876031364478976:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 508us (724us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789123206.249857:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 176 00000100:00100000:3.0:1789123206.259278:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123206.259438:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364479104 00000100:00100000:0.0:1789123206.259447:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364479104 00000100:00100000:0.0:1789123206.259516:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 177 00000100:00100000:0.0:1789123206.259528:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+58:11718:x1876031364479104:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789123206.259556:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123206.259585:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92752 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f7fe expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.259621:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92759 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.259671:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92759 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.259682:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92759 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.259779:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92752 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7fe expref: 60 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.259798:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92759 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7fe expref: 59 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.259806:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f34226c1200) 00010000:00010000:0.0:1789123206.259809:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789123206.259812:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53a00, rc 0) 00000100:00100000:0.0:1789123206.259865:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+59:11718:x1876031364479104:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 339us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123206.259879:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 177 00000100:00100000:2.0:1789123206.263718:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123206.264219:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364479360 00000100:00100000:0.0:1789123206.264234:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364479360 00000100:00100000:0.0:1789123206.264315:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 178 00000100:00100000:0.0:1789123206.264328:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c3070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+59:11718:x1876031364479360:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789123206.264405:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc92760 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.264432:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc92760 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.264443:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc92760 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789123206.264821:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1789123206.264832:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 320595203897ns, next at 321595201329ns, rc = 0 00000004:00010000:0.0:1789123206.264919:0:5842:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000b5258e38 reply state 000000007b792aa5 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc92760 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123206.264928:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789123206.265032:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c3070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+61:11718:x1876031364479360:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 707us (1329us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1789123206.265040:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 178 00010000:00010000:2.0:1789123206.267560:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc92760 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.267586:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc92760 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.267624:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc92760 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.267660:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52c00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123206.267666:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc92760 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.267677:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc92760 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.267700:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f34226c1200) 00010000:00010000:2.0:1789123206.267704:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789123206.267709:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc92760 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.267716:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc92760 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123206.270374:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123206.271000:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364479488 00000100:00100000:0.0:1789123206.271016:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364479488 00000100:00100000:0.0:1789123206.271202:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 179 00000100:00100000:0.0:1789123206.271217:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435673c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+60:11718:x1876031364479488:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789123206.271249:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123206.271303:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92767 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f805 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.271379:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92767 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f805 expref: 61 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.271489:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92767 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f805 expref: 61 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.271540:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f34226c1200) 00010000:00010000:0.0:1789123206.271543:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789123206.271547:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53e00, rc 0) 00000100:00100000:0.0:1789123206.271674:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435673c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+61:11718:x1876031364479488:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 460us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123206.271683:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 179 00000100:00100000:3.0:1789123206.275563:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123206.275743:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364479616 00000100:00100000:1.0:1789123206.275759:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364479616 00000100:00100000:0.0:1789123206.275927:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 50 00000100:00100000:0.0:1789123206.275941:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f52940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2354:x1876031364479616:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1789123206.276011:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789123206.277827:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f52940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2354:x1876031364479616:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 Request processed in 1880us (2273us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789123206.277840:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 50 00000100:00100000:3.0:1789123206.284581:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123206.284853:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364479872 00000100:00100000:2.0:1789123206.284868:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364479872 00000100:00100000:2.0:1789123206.285032:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 49 00000100:00100000:2.0:1789123206.285045:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340493a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+61:11718:x1876031364479872:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789123206.285388:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340493a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+62:11718:x1876031364479872:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 Request processed in 345us (820us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1789123206.285398:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 49 00000100:00100000:2.0:1789123206.288242:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123206.288380:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364480128 00000100:00100000:0.0:1789123206.288391:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364480128 00000100:00100000:0.0:1789123206.288534:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 180 00000100:00100000:0.0:1789123206.288547:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+62:11718:x1876031364480128:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789123206.288755:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+62:11718:x1876031364480128:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 210us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123206.288775:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 180 00000100:00100000:0.0:1789123206.292258:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123206.292369:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364480256 00000100:00100000:3.0:1789123206.292383:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364480256 00000100:00100000:3.0:1789123206.292457:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 181 00000100:00100000:3.0:1789123206.292470:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+62:11718:x1876031364480256:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789123206.292498:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123206.292539:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc9276e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f80c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.292686:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc92775 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.292706:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc92775 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.292722:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc92775 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123206.292771:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789123206.292795:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc92775 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.292826:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc9276e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f80c expref: 64 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.292867:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc92775 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f80c expref: 63 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.292877:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f34226c1200) 00010000:00010000:3.0:1789123206.292880:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789123206.292884:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbb400, rc 0) 00000100:00100000:3.0:1789123206.292966:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+63:11718:x1876031364480256:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 498us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123206.292974:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 181 00000100:00100000:3.0:1789123206.297431:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123206.297690:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364480384 00000100:00100000:0.0:1789123206.297709:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364480384 00000100:00100000:0.0:1789123206.297781:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 51 00000100:00100000:0.0:1789123206.297792:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340493a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2355:x1876031364480384:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789123206.297816:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123206.297843:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc9277c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f813 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789123206.297879:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3da86, blocks: 0x1 00010000:00010000:0.0:1789123206.297905:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=320s v=(0 0) 00010000:00010000:0.0:1789123206.297910:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123206.297921:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc9277c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f813 expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.297941:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc9277c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f813 expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.297959:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b52400, rc 0) 00000100:00100000:0.0:1789123206.298032:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340493a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+8:2355:x1876031364480384:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 240us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123206.298040:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 51 00000100:00100000:2.0:1789123206.305469:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123206.305578:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364480640 00000100:00100000:1.0:1789123206.305591:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364480640 00000100:00100000:1.0:1789123206.305709:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 182 00000100:00100000:1.0:1789123206.305722:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+63:11718:x1876031364480640:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789123206.305875:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+63:11718:x1876031364480640:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 155us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123206.305884:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 182 00000100:00100000:3.0:1789123206.311988:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123206.312505:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364480768 00000100:00100000:1.0:1789123206.312537:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364480768 00000100:00100000:1.0:1789123206.312666:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 52 00000100:00100000:1.0:1789123206.312680:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340493bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+8:11718:x1876031364480768:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789123206.312706:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123206.312734:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000067d6f67/0x7e1648d68fc92783 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f81a expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.312777:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc9277c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f813 expref: 9 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.312786:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123206.312791:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123206.312797:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000067d6f67/0x7e1648d68fc92783 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f81a expref: 9 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.312838:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc9277c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f813 expref: 9 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.312853:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc9277c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f813 expref: 9 pid: 6688 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123206.312871:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34063b4780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1876031381255680:192.168.206.30@tcp:104: 00000100:00100000:1.0:1789123206.312983:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3418b9be40 going to sleep for 11 seconds 00000100:00100000:1.0:1789123206.327017:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34063b4780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1876031381255680:192.168.206.30@tcp:104: 00010000:00010000:1.0:1789123206.327079:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000067d6f67/0x7e1648d68fc92783 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f81a expref: 9 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.327127:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd33800, rc 0) 00000100:00100000:1.0:1789123206.327218:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340493bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+9:11718:x1876031364480768:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 14540us (15243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123206.327238:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 52 00000100:00100000:1.0:1789123206.333517:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123206.333769:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364480896 00000100:00100000:3.0:1789123206.333784:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364480896 00010000:00010000:3.0:1789123206.333839:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc9277c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f813 expref: 9 pid: 6688 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123206.333891:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 73 00000100:00100000:3.0:1789123206.333904:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+9:2355:x1876031364480896:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789123206.333924:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123206.333952:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc9277c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f813 expref: 9 pid: 6688 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.333967:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc9277c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f813 expref: 9 pid: 6688 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.334017:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc9277c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f813 expref: 9 pid: 6688 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.334038:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789123206.334044:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789123206.334054:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000067d6f67/0x7e1648d68fc92783 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f81a expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.334081:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000067d6f67/0x7e1648d68fc92783 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f81a expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.334131:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000067d6f67/0x7e1648d68fc92783 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f81a expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123206.334150:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f340493a940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876031381255808:192.168.206.30@tcp:105: 00000100:00100000:3.0:1789123206.334506:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3303e6c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789123206.346720:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123206.346889:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364481024 00000100:00100000:1.0:1789123206.346902:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364481024 00002000:00100000:1.0:1789123206.346964:0:6691:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9f3404938000 x1876031364481024/t0(0) o4->64de9449-4320-4c9f-abcb-230edd2b11ae@192.168.206.30@tcp:472/0 lens 504/0 e 0 to 0 dl 1789123217 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789123206.346975:0:6691:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9f3404938000 with x1876031364481024 ext(0->8) 00002000:00010000:1.0:1789123206.346983:0:6691:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f3404938000 00000100:00100000:1.0:1789123206.347018:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 4 00000100:00100000:1.0:1789123206.347027:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3404938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+9:2355:x1876031364481024:12345-192.168.206.30@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789123206.347612:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3404938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+11:2355:x1876031364481024:12345-192.168.206.30@tcp:4:lhsmtool_posix.0 Request processed in 580us (901us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789123206.347624:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 4 00002000:00100000:1.0:1789123206.347667:0:6691:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9f3404938000 x1876031364481024/t4294967314(0) o4->64de9449-4320-4c9f-abcb-230edd2b11ae@192.168.206.30@tcp:472/0 lens 504/448 e 0 to 0 dl 1789123217 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789123206.347677:0:6691:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9f3404938000 with x1876031364481024 ext(0->8) 00002000:00010000:1.0:1789123206.347681:0:6691:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f3404938000 00000100:00100000:0.0:1789123206.348034:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f340493a940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876031381255808:192.168.206.30@tcp:105: 00010000:00010000:0.0:1789123206.348066:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123206.348120:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+10:2355:x1876031364480896:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 14219us (14620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123206.348130:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 73 00000100:00100000:0.0:1789123206.366732:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123206.366835:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364481152 00000100:00100000:2.0:1789123206.366849:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364481152 00000100:00100000:2.0:1789123206.366918:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 183 00000100:00100000:2.0:1789123206.366929:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3405de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+63:11718:x1876031364481152:12345-192.168.206.30@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789123206.453937:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:0.0:1789123206.453951:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:0.0:1789123206.454001:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f3418b9b0c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1789123206.454009:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f3405d3e500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f3418b9b9c0 00000020:00080000:0.0:1789123206.454013:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f3405d3e000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f3435568c00 00000001:00080000:0.0:1789123206.454029:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:0.0:1789123206.454053:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1789123206.455513:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1789123206.455845:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1789123206.455870:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f340493a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381255936:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789123206.455964:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123206.456063:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381255936 00000100:00100000:3.0:1789123206.456073:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381255936 00000100:00100000:3.0:1789123206.456129:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789123206.456140:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381255936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789123206.456561:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343551a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381256064:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789123206.456762:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123206.456805:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381256064 00000100:00100000:0.0:1789123206.456811:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381256064 00000100:00100000:0.0:1789123206.456846:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789123206.456853:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343551b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381256064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789123206.456872:0:8519:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1789123206.456910:0:8519:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa3da83, atime: 0x6aa3da83, ctime: 0x6aa3da83, blocks: 0xb 00010000:00010000:0.0:1789123206.456919:0:8519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a72858/0x7e1648d68fc9278a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.456937:0:8519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=320s v=(0 0) 00010000:00010000:0.0:1789123206.456942:0:8519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123206.456950:0:8519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a72858/0x7e1648d68fc9278a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.456983:0:8519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a72858/0x7e1648d68fc9278a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.456994:0:8519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a72858/0x7e1648d68fc9278a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.457002:0:8519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a72858/0x7e1648d68fc9278a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.457022:0:8519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789123206.457964:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3405de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+18:11718:x1876031364481152:12345-192.168.206.30@tcp:44:lhsmtool_posix.0 Request processed in 91030us (91239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123206.457977:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 183 00000100:00100000:0.0:1789123206.462168:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343551b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1876031381256064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5305us (5396us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789123206.462183:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:0.0:1789123206.462232:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789123206.462243:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a72858/0x7e1648d68fc9278a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.462257:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52000 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:0.0:1789123206.462262:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a72858/0x7e1648d68fc9278a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.462276:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a72858/0x7e1648d68fc9278a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.462315:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a72858/0x7e1648d68fc9278a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.462332:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a72858/0x7e1648d68fc9278a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.462356:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123206.462358:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123206.462360:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789123206.462652:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789123206.462657:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789123206 00002000:00010000:3.0:1789123206.462660:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789123206.462661:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789123206 -> 1789123206 00002000:00010000:3.0:1789123206.462664:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789123206.462716:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1876031381255936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 6576us (6751us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789123206.462724:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000004:00080000:2.0:1789123206.463485:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f343551a1c0/2, rc 0, transno 4294967307 00000100:00100000:2.0:1789123206.463496:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343551a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381256064:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1789123206.465575:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f340493a940/2, rc 0, transno 4294967315 00000100:00100000:0.0:1789123206.465687:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f340493a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381255936:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789123206.466947:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123206.467110:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364481280 00000100:00100000:2.0:1789123206.467121:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364481280 00000100:00100000:2.0:1789123206.467196:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 55 00000100:00100000:2.0:1789123206.467208:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435519e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+10:2355:x1876031364481280:12345-192.168.206.30@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789123206.548437:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:3.0:1789123206.548463:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:3.0:1789123206.548475:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1789123206.548680:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435519e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2355:x1876031364481280:12345-192.168.206.30@tcp:16:lhsmtool_posix.0 Request processed in 81389us (81657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123206.548693:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 55 00000100:00100000:3.0:1789123206.553524:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123206.553765:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364481536 00000100:00100000:0.0:1789123206.553779:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364481536 00000100:00100000:0.0:1789123206.553844:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 184 00000100:00100000:0.0:1789123206.553857:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343fc043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+18:11718:x1876031364481536:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789123206.553928:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123206.553961:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb400/0x7e1648d68fc92775 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f80c expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.553982:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f34226c1200) 00010000:00010000:0.0:1789123206.553987:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789123206.554024:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc92791 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.554039:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc92791 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.554049:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc92791 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789123206.554382:0:5841:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000066eed9a reply state 00000000449d9e8d transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc92791 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123206.554393:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789123206.554521:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343fc043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+19:11718:x1876031364481536:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 665us (1010us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1789123206.554530:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 184 00010000:00010000:3.0:1789123206.556438:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc92791 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.556458:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc92791 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.556467:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc92791 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.556475:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123206.556481:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc92791 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.556490:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc92791 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.556523:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f34226c1200) 00010000:00010000:3.0:1789123206.556527:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123206.556533:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc92791 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.556540:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc92791 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123206.568865:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123206.572461:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364481664 00000100:00100000:3.0:1789123206.572481:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364481664 00000100:00100000:0.0:1789123206.572718:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 56 00000100:00100000:0.0:1789123206.572734:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435518780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2355:x1876031364481664:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789123206.573094:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789123206.573100:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789123206 -> 1789123205 00002000:00010000:0.0:1789123206.573102:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789123203 00002000:00010000:0.0:1789123206.573105:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789123206 -> 1789123205 00002000:00010000:0.0:1789123206.573108:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789123206.573206:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435518780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+8:2355:x1876031364481664:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 Request processed in 475us (4354us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789123206.573216:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 56 00000100:00100000:2.0:1789123206.577810:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123206.577897:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364481920 00000100:00100000:3.0:1789123206.577911:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364481920 00000100:00100000:3.0:1789123206.577983:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 185 00000100:00100000:3.0:1789123206.577995:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+18:11718:x1876031364481920:12345-192.168.206.30@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789123206.578089:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc92798 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.578110:0:7640:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92759 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7fe expref: 18 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.578121:0:7640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc92798 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.578167:0:7640:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92759 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7fe expref: 18 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.578197:0:7640:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92759 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7fe expref: 18 pid: 7640 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123206.578311:0:7640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3407d3cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1876031381256192:192.168.206.30@tcp:104: 00000100:00100000:3.0:1789123206.578431:0:7640:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3303e6c780 going to sleep for 11 seconds 00000100:00100000:3.0:1789123206.582536:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123206.582971:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364482048 00000100:00100000:1.0:1789123206.582984:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364482048 00010000:00010000:1.0:1789123206.583040:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92759 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7fe expref: 19 pid: 7640 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123206.583100:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 74 00000100:00100000:1.0:1789123206.583112:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407d3f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+19:2355:x1876031364482048:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789123206.583131:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123206.583139:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92759 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7fe expref: 19 pid: 7640 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.583155:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92759 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7fe expref: 19 pid: 7640 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.583195:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f34226c1200) 00010000:00010000:1.0:1789123206.583201:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc92798 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.583212:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc92798 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.583221:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc92798 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.583250:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789123206.583321:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407d3f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+19:2355:x1876031364482048:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 211us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123206.583330:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 74 00010000:00010000:0.0:1789123206.584961:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92759 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7fe expref: 18 pid: 7640 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123206.584995:0:7640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3407d3cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1876031381256192:192.168.206.30@tcp:104: 00010000:00010000:0.0:1789123206.585026:0:7640:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc92798 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.585052:0:7640:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc92798 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.585059:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc92798 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.585112:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc92798 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.585119:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc92798 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.585127:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc92798 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.585134:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fba400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123206.585140:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc92798 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.585147:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc92798 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.585165:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f34226c1200) 00010000:00010000:0.0:1789123206.585169:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789123206.585184:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc92798 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.585190:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba400/0x7e1648d68fc92798 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123206.585408:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+17:11718:x1876031364481920:12345-192.168.206.30@tcp:55:lhsmtool_posix.0 Request processed in 7414us (7610us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789123206.585426:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 185 00000100:00100000:0.0:1789123206.595072:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123206.595384:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364482176 00000100:00100000:3.0:1789123206.595399:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364482176 00000100:00100000:3.0:1789123206.595506:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 57 00000100:00100000:3.0:1789123206.595520:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+8:2354:x1876031364482176:12345-192.168.206.30@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789123206.595585:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f48b05fc/0x7e1648d68fc9279f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.595621:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000067d6f67/0x7e1648d68fc92783 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f81a expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.595659:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789123206.595665:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789123206.595671:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f48b05fc/0x7e1648d68fc9279f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.595717:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000067d6f67/0x7e1648d68fc92783 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f81a expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.595733:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000067d6f67/0x7e1648d68fc92783 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f81a expref: 8 pid: 6687 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123206.595749:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3407d3c3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1876031381256320:192.168.206.30@tcp:104: 00000100:00100000:3.0:1789123206.595866:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3303e6cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789123206.602112:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123206.602151:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364482304 00000100:00100000:1.0:1789123206.602162:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364482304 00000100:00100000:3.0:1789123206.602397:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3407d3c3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1876031381256320:192.168.206.30@tcp:104: 00010000:00010000:3.0:1789123206.602429:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f48b05fc/0x7e1648d68fc9279f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.602507:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000067d6f67/0x7e1648d68fc92783 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f81a expref: 9 pid: 6687 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123206.602561:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 75 00000100:00100000:1.0:1789123206.602572:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d768b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+9:2355:x1876031364482304:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789123206.602703:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123206.602736:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000067d6f67/0x7e1648d68fc92783 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f81a expref: 9 pid: 6687 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.602751:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000067d6f67/0x7e1648d68fc92783 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f81a expref: 9 pid: 6687 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.602779:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000067d6f67/0x7e1648d68fc92783 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f81a expref: 9 pid: 6687 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.602796:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789123206.602801:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789123206.602806:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f48b05fc/0x7e1648d68fc9279f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.602817:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f48b05fc/0x7e1648d68fc9279f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.602850:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789123206.602915:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d768b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+8:2355:x1876031364482304:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 344us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123206.602923:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 75 00010000:00010000:3.0:1789123206.602981:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f48b05fc/0x7e1648d68fc9279f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.602991:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f48b05fc/0x7e1648d68fc9279f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.603020:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f48b05fc/0x7e1648d68fc9279f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.603028:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f48b05fc/0x7e1648d68fc9279f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.603037:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f48b05fc/0x7e1648d68fc9279f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.603044:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbb200 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:3.0:1789123206.603049:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f48b05fc/0x7e1648d68fc9279f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.603059:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f48b05fc/0x7e1648d68fc9279f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.603095:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f48b05fc/0x7e1648d68fc9279f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.603103:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f48b05fc/0x7e1648d68fc9279f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123206.603152:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2354:x1876031364482176:12345-192.168.206.30@tcp:1:lhsmtool_posix.0 Request processed in 7636us (8096us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123206.603159:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 57 00000100:00100000:1.0:1789123206.610040:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123206.612335:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364482560 00000100:00100000:0.0:1789123206.612352:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364482560 00000100:00100000:1.0:1789123206.612480:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 186 00000100:00100000:1.0:1789123206.612491:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d76b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+17:11718:x1876031364482560:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789123206.612583:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc927a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.612602:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc927a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.612616:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc927a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.612886:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc927ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.612898:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92767 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f805 expref: 18 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.612907:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc927ad lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.612947:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92767 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f805 expref: 18 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.612962:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92767 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f805 expref: 18 pid: 7640 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123206.612977:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3418488f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876031381256448:192.168.206.30@tcp:104: 00000100:00100000:1.0:1789123206.613090:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3405d2c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123206.617794:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123206.617903:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364482688 00000100:00100000:0.0:1789123206.617917:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364482688 00010000:00010000:0.0:1789123206.617975:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92767 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f805 expref: 19 pid: 7640 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123206.618029:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 76 00000100:00100000:0.0:1789123206.618040:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3406285450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+19:2354:x1876031364482688:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789123206.618057:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123206.618074:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92767 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f805 expref: 19 pid: 7640 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.618089:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92767 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f805 expref: 19 pid: 7640 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.618122:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f34226c1200) 00010000:00010000:0.0:1789123206.618128:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc927ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.618139:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc927ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.618148:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc927ad lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.618171:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123206.618252:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3406285450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+19:2354:x1876031364482688:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 213us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123206.618261:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 76 00010000:00010000:3.0:1789123206.619787:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92767 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f805 expref: 18 pid: 7640 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123206.619809:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3418488f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876031381256448:192.168.206.30@tcp:104: 00010000:00010000:3.0:1789123206.619836:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc927ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.619847:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc927ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.619852:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc927ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789123206.620806:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1789123206.621012:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1789123206.621059:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1789123206.622561:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3407d3c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1876031381256576:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789123206.622946:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123206.622996:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3303e6cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789123206.623321:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381256576 00000100:00100000:1.0:1789123206.623330:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381256576 00000100:00100000:1.0:1789123206.623395:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789123206.623408:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407d3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1876031381256576:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789123206.623518:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407d3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1876031381256576:12345-0@lo:1000:mdt00_001.0 Request processed in 112us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123206.623527:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789123206.623743:0:5841:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1789123206.623750:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f340493a940, transno 4294967315 00000100:00100000:3.0:1789123206.623768:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3407d3c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1876031381256576:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789123206.624593:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1789123206.625052:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3407d3c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1876031381256704:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789123206.625131:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123206.625167:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3303e6cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789123206.625331:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381256704 00000100:00100000:1.0:1789123206.625340:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381256704 00000100:00100000:1.0:1789123206.625394:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789123206.625405:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407d3f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1876031381256704:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789123206.625625:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407d3f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1876031381256704:12345-0@lo:1000:mdt00_001.0 Request processed in 221us (492us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789123206.625662:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789123206.625836:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3407d3c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1876031381256704:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1789123206.625882:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc927ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.625894:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc927ad lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.625903:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc927ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.625910:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123206.625916:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc927ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.625925:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc927ad lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.625946:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f34226c1200) 00010000:00010000:3.0:1789123206.625950:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789123206.625956:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc927ad lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.625975:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc927ad lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.626013:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc926e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.626020:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc926e2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.626026:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc926e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.626031:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80ba00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123206.626034:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc926e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.626041:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc926e2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.626051:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f34232f7b00) 00010000:00010000:3.0:1789123206.626054:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789123206.626057:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc926e2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.626076:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc926e2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.626104:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc927b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.626120:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc926fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7e9 expref: 21 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.626135:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc927b4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.626165:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc926fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7e9 expref: 21 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.626401:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc926fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7e9 expref: 21 pid: 7640 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123206.626419:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3407d3cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876031381256832:192.168.206.30@tcp:104: 00000100:00100000:3.0:1789123206.626516:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3303e6cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789123206.636698:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123206.637644:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364482816 00000100:00100000:0.0:1789123206.637658:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364482816 00010000:00010000:0.0:1789123206.637715:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc926fe lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7e9 expref: 22 pid: 7640 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123206.637761:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 77 00000100:00100000:0.0:1789123206.637773:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3418489e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+22:2354:x1876031364482816:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789123206.637793:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123206.637801:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc926fe lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7e9 expref: 22 pid: 7640 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.637817:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc926fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7e9 expref: 22 pid: 7640 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.637844:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f34232f7b00) 00010000:00010000:0.0:1789123206.637851:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc927b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.637862:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc927b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.637871:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc927b4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.637896:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123206.637969:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3418489e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+22:2354:x1876031364482816:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 198us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123206.637986:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 77 00010000:00010000:3.0:1789123206.641261:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc926fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f7e9 expref: 21 pid: 7640 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123206.641306:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3407d3cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876031381256832:192.168.206.30@tcp:104: 00010000:00010000:3.0:1789123206.641743:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc927b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.641845:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc927b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.641854:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc927b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.641872:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc927b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.641879:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc927b4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.641886:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc927b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.641909:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbb200 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123206.641914:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc927b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.641922:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc927b4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.641943:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f34232f7b00) 00010000:00010000:1.0:1789123206.641946:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123206.641952:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc927b4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.641958:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb200/0x7e1648d68fc927b4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.641971:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc927a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.641977:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc927a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.641983:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc927a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.641987:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32a00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123206.641990:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc927a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.641996:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc927a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.642018:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f34232f7b00) 00010000:00010000:1.0:1789123206.642020:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789123206.642023:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc927a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123206.642029:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc927a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123206.642384:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d76b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+20:11718:x1876031364482560:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 29890us (32352us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1789123206.642396:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 186 00000020:00080000:1.0:1789123206.642403:0:5841:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789123206.642583:0:12081:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789123206.642589:0:12081:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789123206.643171:0:12081:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1789123206.643180:0:12081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789123206.646421:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123206.646551:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364483072 00000100:00100000:3.0:1789123206.646565:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364483072 00000100:00100000:3.0:1789123206.646668:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 50 00000100:00100000:3.0:1789123206.646679:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427abec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+20:11718:x1876031364483072:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789123206.647918:0:5844:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789123206.648051:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1789123206.649933:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc927bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.649960:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc927bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.649973:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc927bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.649996:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc927bb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.650002:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc927bb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.650008:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc927bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123206.650075:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789123206.650228:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427abec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+22:11718:x1876031364483072:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 Request processed in 3544us (3815us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1789123206.650239:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 50 00000020:00080000:2.0:1789123206.650247:0:5844:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789123206.655859:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789123206.655882:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc927bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.655913:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80ae00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:3.0:1789123206.655918:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc927bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.655931:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc927bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.655954:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f34232f7400) 00010000:00010000:3.0:1789123206.655958:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789123206.655964:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc927bb lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123206.655970:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc927bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123206.660432:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123206.660440:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123206.660443:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123206.660877:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789123206.948037:0:12808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789123206.948050:0:12808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789123206.948098:0:12808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789123206.948106:0:12808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789123207.217859:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123207.217955:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364483328 00000100:00100000:2.0:1789123207.217968:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364483328 00000100:00100000:2.0:1789123207.218065:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 187 00000100:00100000:2.0:1789123207.218077:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+22:11728:x1876031364483328:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1789123207.218106:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123207.218131:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc927c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f821 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123207.218486:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc927c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123207.218505:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc927c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123207.218521:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc927c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123207.218544:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1789123207.218777:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc927c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f821 expref: 25 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123207.218797:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc927c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f821 expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123207.218807:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:2.0:1789123207.218810:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789123207.218814:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80b400, rc 0) 00000100:00100000:2.0:1789123207.218886:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+24:11728:x1876031364483328:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 812us (1042us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1789123207.218894:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 187 00000100:00080000:1.0:1789123207.219228:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789123207.235142:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123207.235249:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364483456 00000100:00100000:3.0:1789123207.235263:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364483456 00000100:00100000:3.0:1789123207.235363:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 188 00000100:00100000:3.0:1789123207.235376:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+24:11728:x1876031364483456:12345-192.168.206.30@tcp:34:lfs.0 00010000:00010000:3.0:1789123207.235481:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc927d7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.235510:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc927d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.235524:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc927d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.235544:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc927de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.235568:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc927de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.235575:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc927de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.235942:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc927e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.235952:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc927e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.235960:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc927e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789123207.236010:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc927e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.236025:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc927d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.236033:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc927d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.236040:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc927d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.236047:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbbc00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123207.236051:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc927d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.236059:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc927d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.236082:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:3.0:1789123207.236085:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123207.236091:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc927d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.236098:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc927d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.236111:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc927de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.236117:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc927de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.236123:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc927de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.236129:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbb800 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123207.236132:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc927de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.236138:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc927de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.236146:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f3411751000) 00010000:00010000:3.0:1789123207.236148:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123207.236151:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc927de lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.236157:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc927de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.236181:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc927e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.236187:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc927e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.236193:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc927e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.236199:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbb600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123207.236202:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc927e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.236208:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc927e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.236216:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f3411751700) 00010000:00010000:3.0:1789123207.236218:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123207.236221:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc927e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.236227:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc927e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123207.236338:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+24:11728:x1876031364483456:12345-192.168.206.30@tcp:34:lfs.0 Request processed in 962us (1211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123207.236348:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 188 00000100:00100000:1.0:1789123207.319321:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123207.319571:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364483712 00000100:00100000:1.0:1789123207.319583:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364483712 00000100:00100000:1.0:1789123207.319667:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 189 00000100:00100000:1.0:1789123207.319680:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3418489680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+24:11731:x1876031364483712:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1789123207.319707:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123207.319737:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc927ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f828 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.319830:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc927f3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.319850:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc927f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.319876:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc927f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.319894:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc927fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.319901:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc927fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.319908:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc927fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.320576:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92801 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.320589:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92801 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.320597:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92801 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123207.320610:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789123207.320744:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc927f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.320752:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc927f3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.320760:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc927f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.320766:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123207.320778:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc927f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.320787:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc927f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.320801:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:1.0:1789123207.320805:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123207.320810:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc927f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.320817:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc927f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.320829:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc927fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.320836:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc927fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.320842:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc927fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.320847:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33800 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123207.320849:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc927fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.320855:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc927fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.320863:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f340534d800) 00010000:00010000:1.0:1789123207.320866:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123207.320875:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc927fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.320880:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc927fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.320930:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc927ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f828 expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.320945:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92801 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f828 expref: 26 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.320952:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f340534d700) 00010000:00010000:1.0:1789123207.320954:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789123207.320957:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd33c00, rc 0) 00000100:00100000:1.0:1789123207.325604:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3418489680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+26:11731:x1876031364483712:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 5907us (6274us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1789123207.325620:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 189 00000100:00100000:3.0:1789123207.331783:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123207.331827:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364483840 00000100:00100000:3.0:1789123207.331838:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364483840 00000100:00100000:3.0:1789123207.331917:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 190 00000100:00100000:3.0:1789123207.331930:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407d3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+26:11731:x1876031364483840:12345-192.168.206.30@tcp:54:lfs.0 00010000:00010000:3.0:1789123207.332561:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc9280f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.332586:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc9280f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.332601:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc9280f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.332654:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc9280f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.332662:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc9280f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.332669:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc9280f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.332675:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbb600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123207.332680:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc9280f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.332688:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc9280f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.332701:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f340534d700) 00010000:00010000:3.0:1789123207.332705:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789123207.332712:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc9280f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.332731:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb600/0x7e1648d68fc9280f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123207.350593:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407d3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+26:11731:x1876031364483840:12345-192.168.206.30@tcp:54:lfs.0 Request processed in 18647us (18807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123207.350613:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 190 00000100:00100000:3.0:1789123207.353051:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123207.358122:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364484096 00000100:00100000:2.0:1789123207.358144:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364484096 00000100:00100000:3.0:1789123207.360650:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 51 00000100:00100000:3.0:1789123207.360670:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+26:11731:x1876031364484096:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:3.0:1789123207.361017:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+27:11731:x1876031364484096:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 351us (7978us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789123207.361026:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 51 00000100:00100000:1.0:1789123207.415182:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123207.415264:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364484352 00000100:00100000:2.0:1789123207.415285:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364484352 00000100:00100000:2.0:1789123207.415357:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 191 00000100:00100000:2.0:1789123207.415368:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f341848b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+27:11265:x1876031364484352:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:2.0:1789123207.415401:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123207.415428:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc92816 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f82f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123207.415557:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9281d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123207.415574:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92801 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f828 expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123207.415609:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9281d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123207.415703:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92801 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f828 expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123207.415718:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92801 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f828 expref: 28 pid: 5840 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123207.415736:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f340665da40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876031381256960:192.168.206.30@tcp:104: 00000100:00100000:2.0:1789123207.415856:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3403356840 going to sleep for 11 seconds 00000100:00100000:1.0:1789123207.426616:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123207.426731:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364484480 00000100:00100000:0.0:1789123207.426744:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364484480 00010000:00010000:0.0:1789123207.426803:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92801 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f828 expref: 29 pid: 5840 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123207.426850:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 78 00000100:00100000:0.0:1789123207.426861:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f341848b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+29:2355:x1876031364484480:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789123207.426880:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123207.426888:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92801 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f828 expref: 29 pid: 5840 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.426903:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92801 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f828 expref: 29 pid: 5840 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.426931:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f340534d700) 00010000:00010000:0.0:1789123207.426938:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9281d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.426967:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9281d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.426975:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9281d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.427000:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123207.427079:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f341848b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+29:2355:x1876031364484480:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 219us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123207.427088:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 78 00010000:00010000:2.0:1789123207.427516:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92801 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f828 expref: 28 pid: 5840 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123207.427539:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f340665da40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876031381256960:192.168.206.30@tcp:104: 00010000:00010000:2.0:1789123207.427569:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9281d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123207.427580:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9281d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123207.427587:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9281d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123207.427739:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789123207.427934:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc92816 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f82f expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123207.427967:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9281d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f82f expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123207.427975:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f340534d700) 00010000:00010000:2.0:1789123207.427979:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789123207.427982:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80a600, rc 0) 00000100:00100000:2.0:1789123207.428023:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f341848b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+28:11265:x1876031364484352:12345-192.168.206.30@tcp:101:bash.0 Request processed in 12657us (12855us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1789123207.428031:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 191 00000100:00100000:3.0:1789123207.439809:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123207.440299:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364484736 00000100:00100000:1.0:1789123207.440312:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364484736 00000100:00100000:1.0:1789123207.440387:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 192 00000100:00100000:1.0:1789123207.440399:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+28:11265:x1876031364484736:12345-192.168.206.30@tcp:36:bash.0 00010000:00010000:1.0:1789123207.442544:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc9282b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.442567:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc9282b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.442600:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc9282b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789123207.443509:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1789123207.443549:0:5841:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000054a8e5d5 reply state 000000004303c57b transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc9282b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123207.443560:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789123207.443780:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1789123207.444185:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+32:11265:x1876031364484736:12345-192.168.206.30@tcp:36:bash.0 Request processed in 3783us (4387us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1789123207.444194:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 192 00000020:00080000:1.0:1789123207.444200:0:5841:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1789123207.451284:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc9282b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123207.451310:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc9282b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123207.451319:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc9282b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123207.451327:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32a00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123207.451332:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc9282b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123207.451341:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc9282b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123207.451366:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f340534d700) 00010000:00010000:2.0:1789123207.451370:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123207.451377:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc9282b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123207.451397:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc9282b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123207.461812:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123207.462120:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364484864 00000100:00100000:1.0:1789123207.462132:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364484864 00000100:00100000:1.0:1789123207.462212:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 193 00000100:00100000:1.0:1789123207.462234:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409d55e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+31:11265:x1876031364484864:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:1.0:1789123207.462285:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123207.462311:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc92832 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f836 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.462388:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc92832 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f836 expref: 32 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.462415:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc92832 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f836 expref: 32 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.462437:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f340534d700) 00010000:00010000:1.0:1789123207.462453:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789123207.462458:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd33800, rc 0) 00000100:00100000:1.0:1789123207.462525:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409d55e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+32:11265:x1876031364484864:12345-192.168.206.30@tcp:101:bash.0 Request processed in 303us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123207.462533:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 193 00000100:00100000:3.0:1789123207.468867:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123207.472515:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364484992 00000100:00100000:2.0:1789123207.472538:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364484992 00000100:00100000:2.0:1789123207.473572:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 58 00000100:00100000:2.0:1789123207.473588:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+7:11265:x1876031364484992:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:2.0:1789123207.473613:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123207.473674:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000962933c8/0x7e1648d68fc92839 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f83d expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789123207.473711:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa3da85, atime: 0x6aa3da83, ctime: 0x6aa3da85, blocks: 0xb 00010000:00010000:2.0:1789123207.473742:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=321s v=(0 0) 00010000:00010000:2.0:1789123207.473748:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789123207.473759:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000962933c8/0x7e1648d68fc92839 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f83d expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123207.473782:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000962933c8/0x7e1648d68fc92839 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f83d expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123207.473798:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80ac00, rc 0) 00000100:00100000:2.0:1789123207.473909:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+8:11265:x1876031364484992:12345-192.168.206.30@tcp:101:bash.0 Request processed in 323us (5056us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123207.473918:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 58 00000100:00100000:1.0:1789123207.479990:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123207.480076:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364485120 00000100:00100000:0.0:1789123207.480089:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364485120 00002000:00010000:0.0:1789123207.480138:0:6692:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1789123207.480144:0:6692:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9f3418488f00 with x1876031364485120 ext(0->18446744073709551615) 00002000:00010000:0.0:1789123207.480166:0:6692:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f3418488f00. 00000100:00100000:0.0:1789123207.480196:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 5 00000100:00100000:0.0:1789123207.480205:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3418488f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+8:2355:x1876031364485120:12345-192.168.206.30@tcp:10:bash.0 00002000:00010000:0.0:1789123207.480803:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789123207.480809:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789123205 -> 1789123207 00002000:00010000:0.0:1789123207.480812:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789123203 -> 1789123203 00002000:00010000:0.0:1789123207.480814:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789123205 -> 1789123207 00002000:00010000:0.0:1789123207.480817:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789123207.480934:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3418488f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+9:2355:x1876031364485120:12345-192.168.206.30@tcp:10:bash.0 Request processed in 727us (956us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1789123207.480943:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 5 00002000:00010000:0.0:1789123207.480960:0:6692:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1789123207.480964:0:6692:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9f3418488f00 with x1876031364485120 ext(0->18446744073709551615) 00002000:00010000:0.0:1789123207.480969:0:6692:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f3418488f00. 00000100:00100000:3.0:1789123207.548860:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123207.549290:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364485248 00000100:00100000:0.0:1789123207.549305:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364485248 00000100:00100000:0.0:1789123207.549382:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 194 00000100:00100000:0.0:1789123207.549395:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+32:11745:x1876031364485248:12345-192.168.206.30@tcp:34:lfs.0 00010000:00010000:0.0:1789123207.549494:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92840 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.549525:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92840 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.549540:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92840 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.549567:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc92847 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.549575:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc92847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.549582:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc92847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.550002:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc9284e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.550013:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc9284e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.550020:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc9284e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789123207.550082:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc9284e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.550097:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92840 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.550105:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92840 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.550112:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92840 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.550119:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52a00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123207.550124:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92840 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.550132:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92840 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.550148:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:0.0:1789123207.550151:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123207.553033:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92840 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.553057:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92840 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.553085:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc92847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.553093:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc92847 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.553116:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc92847 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.553123:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123207.553127:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc92847 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.553135:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc92847 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.558180:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f34226c1500) 00010000:00010000:0.0:1789123207.558197:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123207.558212:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc92847 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.558769:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc92847 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.558806:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc9284e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.558814:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc9284e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.558822:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc9284e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.558828:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123207.558833:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc9284e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.558864:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc9284e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.558882:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f340534d700) 00010000:00010000:0.0:1789123207.558885:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123207.558890:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc9284e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.558895:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc9284e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123207.559496:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+32:11745:x1876031364485248:12345-192.168.206.30@tcp:34:lfs.0 Request processed in 10094us (10640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123207.559509:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 194 00000100:00100000:3.0:1789123207.649317:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123207.654921:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364485504 00000100:00100000:1.0:1789123207.654944:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364485504 00000100:00100000:1.0:1789123207.655263:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 195 00000100:00100000:1.0:1789123207.655287:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c308f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+32:11748:x1876031364485504:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1789123207.655316:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123207.655356:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc92855 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f844 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.655877:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc9285c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.655898:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc9285c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.655913:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc9285c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.655933:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc92863 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.655941:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc92863 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.655948:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc92863 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.660344:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc9286a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.660375:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc9286a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.660391:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc9286a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123207.660407:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789123207.663421:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc9285c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.663447:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc9285c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.663456:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc9285c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.663463:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123207.663469:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc9285c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.663478:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc9285c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.663496:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:1.0:1789123207.663500:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123207.663759:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc9285c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.663789:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc9285c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.663809:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc92863 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.663816:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc92863 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.663822:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc92863 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.663827:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32200 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123207.663830:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc92863 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.663836:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc92863 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.663845:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f340534d800) 00010000:00010000:1.0:1789123207.663848:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123207.663851:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc92863 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.663857:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc92863 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.663933:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33000/0x7e1648d68fc92855 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f844 expref: 35 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.663950:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc9286a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f844 expref: 34 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.663964:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f340534d700) 00010000:00010000:1.0:1789123207.663967:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789123207.663970:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd32400, rc 0) 00000100:00100000:1.0:1789123207.664080:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c308f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+34:11748:x1876031364485504:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 8804us (14776us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1789123207.664091:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 195 00000100:00100000:1.0:1789123207.669122:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123207.669305:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364485632 00000100:00100000:0.0:1789123207.669318:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364485632 00000100:00100000:0.0:1789123207.669402:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 196 00000100:00100000:0.0:1789123207.669414:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340493a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+34:11748:x1876031364485632:12345-192.168.206.30@tcp:54:lfs.0 00010000:00010000:0.0:1789123207.669516:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc92878 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.669536:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9281d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f82f expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.669548:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc92878 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.669614:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9281d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f82f expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.669685:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9281d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f82f expref: 34 pid: 5840 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123207.669704:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435670780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876031381257088:192.168.206.30@tcp:104: 00000100:00100000:0.0:1789123207.669820:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3435910240 going to sleep for 11 seconds 00000100:00100000:3.0:1789123207.672950:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123207.673428:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364485888 00000100:00100000:1.0:1789123207.673440:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364485888 00000100:00100000:1.0:1789123207.673509:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 52 00000100:00100000:1.0:1789123207.673520:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c308b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+35:5590:x1876031364485888:12345-192.168.206.30@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789123207.674100:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c308b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+36:5590:x1876031364485888:12345-192.168.206.30@tcp:35:ldlm_bl.0 Request processed in 579us (1161us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1789123207.674110:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 52 00000100:00100000:2.0:1789123207.678406:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123207.678616:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364486016 00000100:00100000:3.0:1789123207.678660:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364486016 00010000:00010000:3.0:1789123207.678727:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9281d lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f82f expref: 36 pid: 5840 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123207.678774:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 79 00000100:00100000:3.0:1789123207.678787:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+36:2355:x1876031364486016:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789123207.678804:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123207.678826:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9281d lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f82f expref: 36 pid: 5840 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.678841:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9281d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f82f expref: 36 pid: 5840 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.680387:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f340534d700) 00010000:00010000:3.0:1789123207.680395:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc92878 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.680409:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc92878 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.680419:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc92878 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123207.680450:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789123207.682070:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+36:2355:x1876031364486016:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 3269us (3664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123207.682088:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 79 00010000:00010000:0.0:1789123207.682494:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc9281d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f82f expref: 35 pid: 5840 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123207.682536:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435670780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876031381257088:192.168.206.30@tcp:104: 00010000:00010000:0.0:1789123207.682566:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc92878 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.682578:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc92878 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.682594:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc92878 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.682655:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc92878 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.682663:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc92878 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.682684:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc92878 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.682691:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123207.682713:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc92878 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.682721:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc92878 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.682738:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f340534d700) 00010000:00010000:0.0:1789123207.682741:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789123207.682748:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc92878 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.682754:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc92878 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123207.682833:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340493a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+34:11748:x1876031364485632:12345-192.168.206.30@tcp:54:lfs.0 Request processed in 13421us (13725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123207.682841:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 196 00000100:00100000:1.0:1789123207.685121:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789123207.685151:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c309680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381257216:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789123207.685835:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123207.688257:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123207.689497:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381257216 00000100:00100000:3.0:1789123207.689522:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381257216 00000100:00100000:3.0:1789123207.689882:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789123207.689897:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435670780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1876031381257216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789123207.689958:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789123207.690129:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435670780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1876031381257216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 235us (1882us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123207.690138:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789123207.690342:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123207.690437:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364486272 00000100:00100000:3.0:1789123207.690456:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364486272 00000100:00100000:3.0:1789123207.690495:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 53 00000100:00100000:3.0:1789123207.690502:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340493a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+34:11748:x1876031364486272:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:0.0:1789123207.690696:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c309680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381257216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789123207.691372:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340493a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+35:11748:x1876031364486272:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 867us (1030us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789123207.691381:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 53 00000100:00100000:2.0:1789123207.837018:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123207.837867:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364486528 00000100:00100000:1.0:1789123207.837881:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364486528 00000100:00100000:1.0:1789123207.837967:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 197 00000100:00100000:1.0:1789123207.837979:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301f50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+35:11759:x1876031364486528:12345-192.168.206.30@tcp:101:cat.0 00010000:00010000:1.0:1789123207.838020:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123207.838047:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc9287f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f84b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.838325:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc92886 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.838344:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc92886 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.838358:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc92886 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.838376:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc9288d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.838384:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc9288d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.838392:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc9288d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.841331:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92894 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.841356:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92894 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.841370:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92894 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123207.841386:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1789123207.841524:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc92886 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.841532:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc92886 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.841551:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc92886 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.841558:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123207.841564:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc92886 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.841572:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc92886 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.841596:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:1.0:1789123207.841600:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123207.841605:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc92886 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.841613:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc92886 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.841837:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc9288d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.841846:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc9288d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.841851:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc9288d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.841856:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32a00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123207.841859:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc9288d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.841875:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc9288d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.841884:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f340534d800) 00010000:00010000:1.0:1789123207.841887:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123207.841890:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc9288d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.841896:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc9288d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.841966:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc9287f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f84b expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.841983:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92894 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f84b expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.841990:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f340534d700) 00010000:00010000:1.0:1789123207.841992:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789123207.841995:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd33c00, rc 0) 00000100:00100000:1.0:1789123207.842118:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301f50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+37:11759:x1876031364486528:12345-192.168.206.30@tcp:101:cat.0 Request processed in 4140us (5115us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1789123207.842129:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 197 00000100:00100000:3.0:1789123207.851606:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123207.851762:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364486784 00000100:00100000:0.0:1789123207.851774:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364486784 00000100:00100000:0.0:1789123207.851842:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 54 00000100:00100000:0.0:1789123207.851855:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c3083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+37:11759:x1876031364486784:12345-192.168.206.30@tcp:35:cat.0 00000100:00100000:0.0:1789123207.852205:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c3083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+38:11759:x1876031364486784:12345-192.168.206.30@tcp:35:cat.0 Request processed in 351us (623us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789123207.852214:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 54 00000100:00100000:3.0:1789123207.923447:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123207.923836:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364487040 00000100:00100000:0.0:1789123207.923849:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364487040 00000100:00100000:0.0:1789123207.923945:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 198 00000100:00100000:0.0:1789123207.923958:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c309e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+38:11760:x1876031364487040:12345-192.168.206.30@tcp:36:rm.0 00010000:00010000:0.0:1789123207.924049:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789123207.924098:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92894 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f84b expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.924126:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc9286a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f844 expref: 37 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.924140:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc92832 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f836 expref: 36 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.924152:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f340534d700) 00010000:00010000:0.0:1789123207.924172:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789123207.924201:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc928a2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.924218:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc928a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.924230:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc928a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.924246:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc928a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.924253:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc928a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.924260:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc928a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.925653:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc928b0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.925684:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc928b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.925696:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc928b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789123207.926579:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1789123207.926595:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 322256966143ns, next at 323256962917ns, rc = 0 00010000:00010000:0.0:1789123207.926705:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53200/0x7e1648d68fc928b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.926719:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53200/0x7e1648d68fc928b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.926730:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53200/0x7e1648d68fc928b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.926739:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53200/0x7e1648d68fc928b7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.926746:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53200/0x7e1648d68fc928b7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.926753:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53200/0x7e1648d68fc928b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.926789:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789123207.926819:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc928b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.926834:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc928b0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.926841:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc928b0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.926847:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52a00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123207.926853:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc928b0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.926861:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc928b0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.926876:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f34226c1d00) 00010000:00010000:0.0:1789123207.926880:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789123207.926886:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc928b0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.926892:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc928b0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.926912:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc928a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.926918:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc928a2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.926924:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc928a2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.926929:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123207.926938:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc928a2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.926944:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc928a2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.926953:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:0.0:1789123207.926956:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123207.926958:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc928a2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.926964:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc928a2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789123207.926975:0:5842:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000526ba274 reply state 000000002a0290c3 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc928a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123207.926985:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789123207.927099:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c309e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+37:11760:x1876031364487040:12345-192.168.206.30@tcp:36:rm.0 Request processed in 3138us (3661us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1789123207.927110:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 198 00010000:00010000:1.0:1789123207.928816:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789123207.928834:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53200/0x7e1648d68fc928b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.928846:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53200 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123207.928867:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53200/0x7e1648d68fc928b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.928878:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53200/0x7e1648d68fc928b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.928899:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f34226c1d00) 00010000:00010000:1.0:1789123207.928902:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789123207.928908:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53200/0x7e1648d68fc928b7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.928915:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53200/0x7e1648d68fc928b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123207.928942:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123207.928945:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123207.928947:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123207.943851:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc928a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.943874:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc928a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.943883:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc928a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.943890:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123207.943895:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc928a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.943920:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc928a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.943942:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f34226c1500) 00010000:00010000:0.0:1789123207.943945:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123207.943952:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc928a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123207.943958:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc928a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123208.014331:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123208.014501:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364487296 00000100:00100000:2.0:1789123208.014518:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364487296 00000100:00100000:2.0:1789123208.014608:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 199 00000100:00100000:2.0:1789123208.014621:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+36:11766:x1876031364487296:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:2.0:1789123208.014920:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123208.014949:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc928be lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f852 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.015302:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc928c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.015323:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc928c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.015339:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc928c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.015358:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc928cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.015366:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc928cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.015374:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc928cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789123208.017329:0:7640:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1789123208.017561:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc928d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.017578:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc928d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.017600:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc928d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.020106:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc928c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.020126:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc928c5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.020134:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc928c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.020142:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80ba00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123208.020148:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc928c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.020156:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc928c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.020178:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:2.0:1789123208.020182:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123208.020189:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc928c5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.020196:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc928c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789123208.020217:0:7640:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e272d4b4 reply state 000000004a558cf9 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc928cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123208.020227:0:7640:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789123208.020321:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc928be lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f852 expref: 39 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.020340:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc928d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f852 expref: 38 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.020348:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7500) 00010000:00010000:2.0:1789123208.020350:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789123208.020353:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80bc00, rc 0) 00000100:00100000:2.0:1789123208.020467:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+39:11766:x1876031364487296:12345-192.168.206.30@tcp:101:bash.0 Request processed in 5849us (6143us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1789123208.020477:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 199 00010000:00010000:2.0:1789123208.023098:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc928cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.023124:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc928cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.023132:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc928cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.023139:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123208.023145:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc928cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.023154:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc928cc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.023176:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f34232f7800) 00010000:00010000:2.0:1789123208.023180:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123208.023206:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc928cc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.023214:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc928cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123208.025157:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123208.030450:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364487424 00000100:00100000:0.0:1789123208.030464:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364487424 00000100:00100000:0.0:1789123208.030561:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 59 00000100:00100000:0.0:1789123208.030572:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2352:x1876031364487424:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:0.0:1789123208.030600:0:8519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123208.030621:0:8519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000704eec67/0x7e1648d68fc928e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f859 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789123208.030668:0:8519:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789123208.030699:0:8519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=322s v=(0 0) 00010000:00010000:0.0:1789123208.030704:0:8519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123208.030714:0:8519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000704eec67/0x7e1648d68fc928e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f859 expref: 6 pid: 8519 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789123208.030716:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789123208.030741:0:8519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000704eec67/0x7e1648d68fc928e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f859 expref: 6 pid: 8519 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.030794:0:8519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53400, rc 0) 00000100:00100000:0.0:1789123208.030867:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2352:x1876031364487424:12345-192.168.206.30@tcp:101:bash.0 Request processed in 296us (5718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123208.030875:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 59 00000100:00100000:3.0:1789123208.036619:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123208.039404:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364487552 00000100:00100000:0.0:1789123208.039416:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364487552 00000100:00100000:0.0:1789123208.039497:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 60 00000100:00100000:0.0:1789123208.039515:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+6:11766:x1876031364487552:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:0.0:1789123208.039532:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123208.039550:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038f0f86b/0x7e1648d68fc928e8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f860 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.039580:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000704eec67/0x7e1648d68fc928e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f859 expref: 7 pid: 8519 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.039590:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123208.039594:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123208.039599:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038f0f86b/0x7e1648d68fc928e8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f860 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.039678:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000704eec67/0x7e1648d68fc928e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f859 expref: 7 pid: 8519 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.039691:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000704eec67/0x7e1648d68fc928e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f859 expref: 7 pid: 8519 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123208.039722:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435671e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1876031381257344:192.168.206.30@tcp:104: 00000100:00100000:0.0:1789123208.039820:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3435910780 going to sleep for 11 seconds 00000100:00100000:0.0:1789123208.045022:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435671e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1876031381257344:192.168.206.30@tcp:104: 00010000:00010000:0.0:1789123208.045087:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000038f0f86b/0x7e1648d68fc928e8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f860 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.045116:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53600, rc 0) 00000100:00100000:0.0:1789123208.045211:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+7:11766:x1876031364487552:12345-192.168.206.30@tcp:101:bash.0 Request processed in 5703us (8605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123208.045222:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 60 00000100:00100000:3.0:1789123208.046226:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123208.046283:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364487680 00000100:00100000:3.0:1789123208.046293:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364487680 00010000:00010000:3.0:1789123208.046340:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000704eec67/0x7e1648d68fc928e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f859 expref: 7 pid: 8519 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123208.046383:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 80 00000100:00100000:3.0:1789123208.046395:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2354:x1876031364487680:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789123208.046415:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123208.046445:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000704eec67/0x7e1648d68fc928e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f859 expref: 7 pid: 8519 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.046459:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000704eec67/0x7e1648d68fc928e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f859 expref: 7 pid: 8519 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.046519:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000704eec67/0x7e1648d68fc928e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f859 expref: 7 pid: 8519 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.046539:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789123208.046544:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789123208.046554:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000038f0f86b/0x7e1648d68fc928e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f860 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.046566:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038f0f86b/0x7e1648d68fc928e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f860 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.046611:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000038f0f86b/0x7e1648d68fc928e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f860 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123208.047535:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c3092c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1876031381257472:192.168.206.30@tcp:105: 00000100:00100000:3.0:1789123208.047682:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3418274180 going to sleep for 11 seconds 00000100:00100000:3.0:1789123208.051895:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c3092c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1876031381257472:192.168.206.30@tcp:105: 00010000:00010000:3.0:1789123208.051923:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789123208.051992:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2354:x1876031364487680:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 5599us (5772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123208.052002:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 80 00000100:00100000:2.0:1789123208.063352:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123208.063519:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364487936 00000100:00100000:0.0:1789123208.063531:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364487936 00000100:00100000:0.0:1789123208.063582:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 55 00000100:00100000:0.0:1789123208.063592:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d32a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+38:11766:x1876031364487936:12345-192.168.206.30@tcp:35:bash.0 00000100:00100000:0.0:1789123208.063962:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d32a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+39:11766:x1876031364487936:12345-192.168.206.30@tcp:35:bash.0 Request processed in 370us (621us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1789123208.063970:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 55 00000100:00100000:2.0:1789123208.292739:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123208.292940:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364488064 00000100:00100000:1.0:1789123208.292950:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364488064 00000100:00100000:1.0:1789123208.293010:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 200 00000100:00100000:1.0:1789123208.293020:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34049a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+39:11782:x1876031364488064:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1789123208.293044:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123208.293064:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc928ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f867 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.293131:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc928f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.293144:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc928f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.293192:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc928f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123208.293250:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1789123208.293254:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789123208.293286:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc928f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.293312:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc928ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f867 expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.293331:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc928f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f867 expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.293338:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:1.0:1789123208.293341:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789123208.293344:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd33400, rc 0) 00000100:00100000:1.0:1789123208.293403:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34049a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+40:11782:x1876031364488064:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 385us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123208.293410:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 200 00000100:00100000:3.0:1789123208.300371:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123208.302728:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364488320 00000100:00100000:1.0:1789123208.302742:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364488320 00000100:00100000:1.0:1789123208.302819:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 201 00000100:00100000:1.0:1789123208.302830:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c3092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+40:11782:x1876031364488320:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1789123208.302850:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123208.302871:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc928fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f86e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.302997:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc92904 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.303013:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc92904 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.303026:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc92904 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123208.303038:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789123208.303160:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc928fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f86e expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.303179:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc92904 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f86e expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.303188:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7500) 00010000:00010000:1.0:1789123208.303191:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789123208.303195:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd32e00, rc 0) 00000100:00100000:1.0:1789123208.303256:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c3092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+42:11782:x1876031364488320:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 427us (3206us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1789123208.303264:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 201 00000100:00100000:2.0:1789123208.307344:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123208.307464:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123208.307568:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364488704 00000100:00100000:0.0:1789123208.307577:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364488704 00000100:00100000:0.0:1789123208.307673:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 202 00000100:00100000:0.0:1789123208.307684:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+42:11782:x1876031364488704:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:0.0:1789123208.307708:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123208.307727:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92912 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f875 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.307824:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc92919 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.307839:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc92919 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.307851:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc92919 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123208.307864:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789123208.307995:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92912 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f875 expref: 45 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.308013:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc92919 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f875 expref: 44 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.308021:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7500) 00010000:00010000:0.0:1789123208.308024:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789123208.308027:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53800, rc 0) 00000100:00100000:0.0:1789123208.308082:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+44:11782:x1876031364488704:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 400us (618us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1789123208.308090:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 202 00000100:00100000:1.0:1789123208.308433:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364488448 00000100:00100000:1.0:1789123208.308440:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364488448 00000100:00100000:1.0:1789123208.308516:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 14 00000100:00100000:1.0:1789123208.308524:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+44:2353:x1876031364488448:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789123208.308535:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123208.308558:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc92904 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f86e expref: 44 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.308571:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7500) 00010000:00010000:1.0:1789123208.308575:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789123208.308601:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+43:2353:x1876031364488448:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 79us (1267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123208.308608:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 14 00000100:00100000:2.0:1789123208.314579:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123208.314707:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364488832 00000100:00100000:0.0:1789123208.314716:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364488832 00000100:00100000:0.0:1789123208.314775:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 61 00000100:00100000:0.0:1789123208.314786:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+6:2353:x1876031364488832:12345-192.168.206.30@tcp:1:lfs.0 00010000:00010000:0.0:1789123208.314828:0:8519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7a8270a/0x7e1648d68fc92927 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.314865:0:8519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000038f0f86b/0x7e1648d68fc928e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f860 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.314874:0:8519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123208.314878:0:8519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789123208.314882:0:8519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7a8270a/0x7e1648d68fc92927 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.314918:0:8519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000038f0f86b/0x7e1648d68fc928e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f860 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.314942:0:8519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000038f0f86b/0x7e1648d68fc928e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f860 expref: 6 pid: 6686 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123208.314958:0:8519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435671e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8519:1876031381257600:192.168.206.30@tcp:104: 00000100:00100000:0.0:1789123208.315050:0:8519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3435910780 going to sleep for 11 seconds 00000100:00100000:0.0:1789123208.319589:0:8519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435671e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8519:1876031381257600:192.168.206.30@tcp:104: 00010000:00010000:0.0:1789123208.319620:0:8519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b7a8270a/0x7e1648d68fc92927 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123208.320981:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123208.321209:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364488960 00000100:00100000:3.0:1789123208.321218:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364488960 00002000:00100000:3.0:1789123208.321309:0:6693:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9f343585e940 x1876031364488960/t0(0) o4->64de9449-4320-4c9f-abcb-230edd2b11ae@192.168.206.30@tcp:474/0 lens 504/0 e 0 to 0 dl 1789123219 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789123208.321320:0:6693:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9f343585e940 with x1876031364488960 ext(0->8) 00010000:00010000:3.0:1789123208.321330:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000038f0f86b/0x7e1648d68fc928e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f860 expref: 7 pid: 6686 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.321347:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000038f0f86b/0x7e1648d68fc928e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f860 expref: 7 pid: 6686 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789123208.321354:0:6693:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9f343585e940 00000100:00100000:3.0:1789123208.321388:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 3 00000100:00100000:3.0:1789123208.321398:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2355:x1876031364488960:12345-192.168.206.30@tcp:4:lfs.0 00000100:00100000:3.0:1789123208.321872:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+9:2355:x1876031364488960:12345-192.168.206.30@tcp:4:lfs.0 Request processed in 474us (898us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789123208.321881:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 3 00002000:00100000:3.0:1789123208.321888:0:6693:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9f343585e940 x1876031364488960/t4294967308(0) o4->64de9449-4320-4c9f-abcb-230edd2b11ae@192.168.206.30@tcp:474/0 lens 504/448 e 0 to 0 dl 1789123219 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789123208.321897:0:6693:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9f343585e940 with x1876031364488960 ext(0->8) 00010000:00010000:3.0:1789123208.321903:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000038f0f86b/0x7e1648d68fc928e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f860 expref: 9 pid: 6686 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.321916:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000038f0f86b/0x7e1648d68fc928e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f860 expref: 9 pid: 6686 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789123208.321923:0:6693:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9f343585e940 00000100:00100000:3.0:1789123208.324736:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123208.327211:0:11614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364489088 00000100:00100000:2.0:1789123208.327228:0:11614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364489088 00010000:00010000:2.0:1789123208.327296:0:11614:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000038f0f86b/0x7e1648d68fc928e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f860 expref: 9 pid: 6686 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123208.327404:0:11614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 81 00000100:00100000:2.0:1789123208.327414:0:11614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+9:2354:x1876031364489088:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789123208.327431:0:11614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789123208.327450:0:11614:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789123208.327453:0:11614:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789123207 00002000:00010000:2.0:1789123208.327456:0:11614:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789123208 00002000:00010000:2.0:1789123208.327458:0:11614:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789123207 00010000:00010000:2.0:1789123208.327464:0:11614:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000038f0f86b/0x7e1648d68fc928e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f860 expref: 9 pid: 6686 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.327478:0:11614:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000038f0f86b/0x7e1648d68fc928e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f860 expref: 9 pid: 6686 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.327516:0:11614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038f0f86b/0x7e1648d68fc928e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f860 expref: 9 pid: 6686 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.327536:0:11614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789123208.327540:0:11614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789123208.327546:0:11614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7a8270a/0x7e1648d68fc92927 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.327556:0:11614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7a8270a/0x7e1648d68fc92927 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.327593:0:11614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123208.327697:0:11614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+8:2354:x1876031364489088:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 284us (2970us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123208.327706:0:11614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 81 00010000:00010000:0.0:1789123208.327764:0:8519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b7a8270a/0x7e1648d68fc92927 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.327773:0:8519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7a8270a/0x7e1648d68fc92927 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.327804:0:8519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7a8270a/0x7e1648d68fc92927 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.327812:0:8519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7a8270a/0x7e1648d68fc92927 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.327820:0:8519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7a8270a/0x7e1648d68fc92927 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.327827:0:8519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53000 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:0.0:1789123208.327831:0:8519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7a8270a/0x7e1648d68fc92927 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.327840:0:8519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7a8270a/0x7e1648d68fc92927 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.327852:0:8519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7a8270a/0x7e1648d68fc92927 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.327861:0:8519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7a8270a/0x7e1648d68fc92927 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123208.327906:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2353:x1876031364488832:12345-192.168.206.30@tcp:1:lfs.0 Request processed in 13122us (13336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123208.327914:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 61 00000100:00100000:3.0:1789123208.331688:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123208.331775:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364489344 00000100:00100000:1.0:1789123208.331785:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364489344 00000100:00100000:1.0:1789123208.331834:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 56 00000100:00100000:1.0:1789123208.331844:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427abcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+43:11782:x1876031364489344:12345-192.168.206.30@tcp:35:lfs.0 00000004:00010000:1.0:1789123208.331907:0:5843:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc92919 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f875 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789123208.332208:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1789123208.332256:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1789123208.332604:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1789123208.332958:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9292e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.332974:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc928d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f852 expref: 47 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.332983:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9292e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.333147:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc928d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f852 expref: 47 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.333196:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc928d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f852 expref: 47 pid: 7640 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123208.333213:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062da940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5843:1876031381257728:192.168.206.30@tcp:104: 00000100:00100000:1.0:1789123208.333375:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3405d2cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789123208.336508:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062da940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5843:1876031381257728:192.168.206.30@tcp:104: 00010000:00010000:1.0:1789123208.336541:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9292e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123208.337434:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123208.337656:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364489472 00000100:00100000:0.0:1789123208.337665:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364489472 00010000:00010000:0.0:1789123208.337706:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc928d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f852 expref: 48 pid: 7640 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123208.337737:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 82 00000100:00100000:0.0:1789123208.337747:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063ca050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+48:2355:x1876031364489472:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789123208.337760:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123208.337767:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc928d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f852 expref: 48 pid: 7640 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.337779:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc928d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f852 expref: 48 pid: 7640 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.337799:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc928d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f852 expref: 48 pid: 7640 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.337816:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7500) 00010000:00010000:0.0:1789123208.337821:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9292e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.337830:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9292e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.337837:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9292e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.337871:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123208.338192:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063ca050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+47:2355:x1876031364489472:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 444us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123208.338215:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 82 00010000:00010000:3.0:1789123208.338682:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9292e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.338692:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9292e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789123208.338812:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1789123208.339348:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1789123208.339864:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c309a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1876031381257856:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789123208.340093:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123208.340179:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3413026240 going to sleep for 11 seconds 00000100:00100000:1.0:1789123208.340280:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381257856 00000100:00100000:1.0:1789123208.340287:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381257856 00000100:00100000:1.0:1789123208.340394:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789123208.340404:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c308780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1876031381257856:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789123208.340494:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c308780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1876031381257856:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 91us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123208.340502:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789123208.340624:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c309a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1876031381257856:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:2.0:1789123208.340964:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789123208.341135:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1789123208.341388:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c309a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1876031381257984:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789123208.341477:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123208.341501:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3418274180 going to sleep for 11 seconds 00000100:00100000:1.0:1789123208.341674:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381257984 00000100:00100000:1.0:1789123208.341680:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381257984 00000100:00100000:1.0:1789123208.341714:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789123208.341722:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1876031381257984:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789123208.341901:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5843:x1876031381257984:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 179us (423us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789123208.341909:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789123208.342104:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c309a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1876031381257984:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789123208.342157:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1789123208.342282:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9292e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.342294:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9292e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.342301:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9292e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.342319:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32e00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123208.342324:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9292e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.342332:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9292e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.342346:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7500) 00010000:00010000:3.0:1789123208.342349:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789123208.342354:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9292e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.342360:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc9292e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789123208.342854:0:5843:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789123208.343132:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1789123208.343143:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 322673515123ns, next at 323673512878ns, rc = 0 00000001:00080000:3.0:1789123208.343152:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1789123208.343262:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7500) 00010000:00010000:3.0:1789123208.343266:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789123208.343283:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc92919 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f875 expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123208.343620:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427abcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+50:11782:x1876031364489344:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 11776us (11940us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1789123208.343653:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 56 00000020:00080000:3.0:1789123208.343659:0:5843:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789123208.349608:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123208.349777:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364489600 00000100:00100000:2.0:1789123208.349789:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364489600 00000100:00100000:2.0:1789123208.349851:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 203 00000100:00100000:2.0:1789123208.349863:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c308b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+50:11782:x1876031364489600:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1789123208.349886:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123208.349908:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc92935 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f87c expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.349983:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc92935 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f87c expref: 51 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.350021:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc92935 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f87c expref: 51 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.350041:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:2.0:1789123208.350045:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789123208.350048:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80ae00, rc 0) 00000100:00100000:2.0:1789123208.350116:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c308b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+51:11782:x1876031364489600:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 255us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123208.350124:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 203 00000100:00100000:0.0:1789123208.354727:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123208.355142:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364489856 00000100:00100000:3.0:1789123208.355153:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364489856 00000100:00100000:3.0:1789123208.355210:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 57 00000100:00100000:3.0:1789123208.355219:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435671e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+51:11782:x1876031364489856:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:3.0:1789123208.355473:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435671e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+52:11782:x1876031364489856:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 254us (755us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1789123208.355482:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 57 00000100:00100000:3.0:1789123208.417072:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123208.417128:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364489984 00000100:00100000:0.0:1789123208.417142:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364489984 00000100:00100000:0.0:1789123208.417260:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 204 00000100:00100000:0.0:1789123208.417281:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c3083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+52:11792:x1876031364489984:12345-192.168.206.30@tcp:34:lfs.0 00010000:00010000:0.0:1789123208.417377:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc9293c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.417396:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc9293c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.417408:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc9293c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.417424:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92943 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.417444:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92943 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.417451:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92943 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.417548:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc9294a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.417554:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc9294a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.417560:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc9294a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789123208.417697:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc9294a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.417711:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc9293c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.417718:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc9293c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.417725:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc9293c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.417730:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52800 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123208.417734:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc9293c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.417741:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc9293c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.417752:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:0.0:1789123208.417755:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123208.417760:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc9293c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.417767:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc9293c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.417782:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92943 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.417787:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92943 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.417799:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92943 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.417804:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53e00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123208.417808:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92943 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.417814:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92943 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.417823:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f34226c1500) 00010000:00010000:0.0:1789123208.417825:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123208.417839:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92943 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.417844:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92943 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.417860:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc9294a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.417865:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc9294a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.417871:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc9294a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.417875:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53a00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123208.417877:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc9294a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.417894:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc9294a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.417902:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:0.0:1789123208.417904:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123208.417908:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc9294a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.417913:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc9294a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123208.418017:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c3083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+52:11792:x1876031364489984:12345-192.168.206.30@tcp:34:lfs.0 Request processed in 747us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123208.418025:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 204 00000100:00100000:0.0:1789123208.446909:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123208.447021:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364490240 00000100:00100000:2.0:1789123208.447030:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364490240 00000100:00100000:2.0:1789123208.447087:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 205 00000100:00100000:2.0:1789123208.447095:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3418489e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+52:11795:x1876031364490240:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1789123208.447115:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123208.447135:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92951 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f883 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.447200:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92958 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.447214:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92958 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.447225:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92958 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.447249:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc9295f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.447280:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc9295f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.447288:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc9295f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.447405:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92966 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.447413:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92966 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.447421:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92966 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123208.447430:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789123208.447506:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92958 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.447514:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92958 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.447521:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92958 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.447527:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123208.447531:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92958 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.447539:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92958 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.447559:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:2.0:1789123208.447562:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123208.447567:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92958 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.447573:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc92958 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.447586:0:7640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc9295f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.447591:0:7640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc9295f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.447597:0:7640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc9295f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.447603:0:7640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80ba00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123208.447606:0:7640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc9295f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.447611:0:7640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc9295f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.447617:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f34232f7100) 00010000:00010000:2.0:1789123208.447619:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123208.447622:0:7640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc9295f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.447927:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ba00/0x7e1648d68fc9295f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.447976:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92951 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f883 expref: 55 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.447989:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92966 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f883 expref: 54 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.447996:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:2.0:1789123208.447999:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789123208.448001:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80bc00, rc 0) 00000100:00100000:2.0:1789123208.448059:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3418489e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+54:11795:x1876031364490240:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 964us (1158us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1789123208.448067:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 205 00000100:00100000:2.0:1789123208.452978:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123208.453144:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364490368 00000100:00100000:1.0:1789123208.453158:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364490368 00000100:00100000:1.0:1789123208.453392:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 206 00000100:00100000:1.0:1789123208.453406:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+54:11795:x1876031364490368:12345-192.168.206.30@tcp:54:lfs.0 00010000:00010000:1.0:1789123208.453507:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92974 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.453531:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92974 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.453546:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92974 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.453582:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92974 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.453590:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92974 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.453598:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92974 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.453605:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32c00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123208.453610:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92974 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.453620:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92974 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.453910:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:1.0:1789123208.453914:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789123208.453920:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92974 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.453941:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92974 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123208.454085:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+54:11795:x1876031364490368:12345-192.168.206.30@tcp:54:lfs.0 Request processed in 680us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123208.454096:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 206 00000100:00100000:3.0:1789123208.457968:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123208.458205:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364490624 00000100:00100000:0.0:1789123208.458221:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364490624 00000100:00100000:0.0:1789123208.458336:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 58 00000100:00100000:0.0:1789123208.458349:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+54:11795:x1876031364490624:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:0.0:1789123208.458728:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+55:11795:x1876031364490624:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 380us (777us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1789123208.458738:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 58 00000100:00100000:0.0:1789123208.526181:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123208.526385:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364490880 00000100:00100000:1.0:1789123208.526522:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364490880 00000100:00100000:1.0:1789123208.526689:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 207 00000100:00100000:1.0:1789123208.526701:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f341848b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+55:11805:x1876031364490880:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:1.0:1789123208.526735:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123208.526740:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789123208.526785:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc928f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f867 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.526816:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:1.0:1789123208.526831:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789123208.526848:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc9297b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f88a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.526993:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92982 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.527008:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92966 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f883 expref: 55 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.527017:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92982 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.527329:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92966 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f883 expref: 55 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.527349:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92966 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f883 expref: 55 pid: 7640 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123208.527366:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062da940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876031381258112:192.168.206.30@tcp:104: 00000100:00100000:1.0:1789123208.527501:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3405d2cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789123208.531160:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062da940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876031381258112:192.168.206.30@tcp:104: 00010000:00010000:1.0:1789123208.531214:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92982 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123208.532031:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123208.533008:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364491008 00000100:00100000:3.0:1789123208.533022:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364491008 00010000:00010000:3.0:1789123208.533140:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92966 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f883 expref: 56 pid: 7640 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123208.533326:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 83 00000100:00100000:3.0:1789123208.533340:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+56:2355:x1876031364491008:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789123208.533358:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123208.533366:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92966 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f883 expref: 56 pid: 7640 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.533381:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92966 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f883 expref: 56 pid: 7640 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.533410:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92966 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f883 expref: 56 pid: 7640 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.533448:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:3.0:1789123208.533455:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92982 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.533465:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92982 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.533474:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92982 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.533514:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789123208.533847:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92982 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.533857:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92982 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123208.533882:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789123208.534400:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc9297b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f88a expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.534423:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92982 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f88a expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.534431:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:1.0:1789123208.534434:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789123208.534451:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd32a00, rc 0) 00000100:00100000:3.0:1789123208.534555:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+56:2355:x1876031364491008:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 1217us (2527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123208.534567:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 83 00000100:00100000:1.0:1789123208.534894:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f341848b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+55:11805:x1876031364490880:12345-192.168.206.30@tcp:101:bash.0 Request processed in 8194us (8727us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1789123208.534903:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 207 00000100:00100000:2.0:1789123208.539293:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123208.539417:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364491264 00000100:00100000:0.0:1789123208.539430:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364491264 00000100:00100000:0.0:1789123208.539538:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 208 00000100:00100000:0.0:1789123208.539551:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+55:11805:x1876031364491264:12345-192.168.206.30@tcp:36:bash.0 00010000:00010000:0.0:1789123208.539998:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92990 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.540021:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92990 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.540036:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92990 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789123208.540098:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1789123208.540123:0:5842:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002af518f4 reply state 000000005c9b6f71 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92990 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123208.540133:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789123208.540255:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+58:11805:x1876031364491264:12345-192.168.206.30@tcp:36:bash.0 Request processed in 706us (997us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1789123208.540264:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 208 00000020:00080000:0.0:1789123208.540280:0:5842:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789123208.542403:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92990 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.542425:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92990 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.542434:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92990 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.542441:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52800 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123208.542446:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92990 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.542456:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92990 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.542490:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:2.0:1789123208.542493:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123208.542499:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92990 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.542506:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92990 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123208.545308:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123208.546004:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364491392 00000100:00100000:1.0:1789123208.546022:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364491392 00000100:00100000:1.0:1789123208.546100:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 209 00000100:00100000:1.0:1789123208.546112:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+57:11805:x1876031364491392:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:1.0:1789123208.546147:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123208.546243:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92997 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f891 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.546387:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc9299e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.546405:0:7640:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92982 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f88a expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.546415:0:7640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc9299e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.546459:0:7640:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92982 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f88a expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.546474:0:7640:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92982 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f88a expref: 58 pid: 5840 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123208.546490:0:7640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062da940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1876031381258240:192.168.206.30@tcp:104: 00000100:00100000:1.0:1789123208.546767:0:7640:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3405d2c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789123208.552966:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123208.553299:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364491520 00000100:00100000:1.0:1789123208.553308:0:7640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062da940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7640:1876031381258240:192.168.206.30@tcp:104: 00000100:00100000:3.0:1789123208.553309:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364491520 00010000:00010000:1.0:1789123208.553346:0:7640:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc9299e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.553361:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92982 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f88a expref: 59 pid: 5840 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123208.553408:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 84 00000100:00100000:3.0:1789123208.553419:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+59:2355:x1876031364491520:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789123208.553438:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123208.553445:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92982 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f88a expref: 59 pid: 5840 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.553458:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92982 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f88a expref: 59 pid: 5840 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.553504:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc92982 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f88a expref: 59 pid: 5840 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.553519:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:3.0:1789123208.553536:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc9299e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.553547:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc9299e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.553555:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc9299e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.553615:0:7640:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc9299e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.553666:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc9299e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123208.553726:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789123208.553733:0:7640:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789123208.553758:0:7640:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc9299e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.553822:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789123208.553888:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+59:2355:x1876031364491520:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 470us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123208.553897:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 84 00010000:00010000:1.0:1789123208.553910:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc92997 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f891 expref: 59 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.553930:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc9299e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f891 expref: 57 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.553939:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:1.0:1789123208.553943:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789123208.553945:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd33400, rc 0) 00000100:00100000:1.0:1789123208.553977:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+57:11805:x1876031364491392:12345-192.168.206.30@tcp:101:bash.0 Request processed in 7868us (8684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123208.553985:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 209 00000100:00100000:2.0:1789123208.557147:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123208.557224:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364491776 00000100:00100000:1.0:1789123208.557245:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364491776 00000100:00100000:1.0:1789123208.557323:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 59 00000100:00100000:1.0:1789123208.557334:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+57:11805:x1876031364491776:12345-192.168.206.30@tcp:35:bash.0 00000100:00100000:1.0:1789123208.557816:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+58:11805:x1876031364491776:12345-192.168.206.30@tcp:35:bash.0 Request processed in 480us (679us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1789123208.557827:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 59 00000100:00100000:3.0:1789123208.605860:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123208.605986:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364491904 00000100:00100000:1.0:1789123208.605998:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364491904 00000100:00100000:1.0:1789123208.606076:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 210 00000100:00100000:1.0:1789123208.606089:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+58:11811:x1876031364491904:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1789123208.606120:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123208.606146:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc929a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f898 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.606242:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc929ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.606259:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc929ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.606283:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc929ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123208.606367:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1789123208.606372:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789123208.606400:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc929ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.606431:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc929a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f898 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.606467:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc929ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f898 expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.606477:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:1.0:1789123208.606480:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789123208.606484:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd32a00, rc 0) 00000100:00100000:1.0:1789123208.606576:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+59:11811:x1876031364491904:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 489us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123208.606583:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 210 00000100:00100000:2.0:1789123208.610403:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123208.610475:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364492032 00000100:00100000:1.0:1789123208.610488:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364492032 00000100:00100000:1.0:1789123208.610555:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 211 00000100:00100000:1.0:1789123208.610566:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+59:11811:x1876031364492032:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1789123208.610590:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123208.610615:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc929b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f89f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.610812:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc929ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.610831:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc929ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.610845:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc929ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.610864:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc929c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.610871:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc929c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.610877:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc929c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.611008:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc929c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.611030:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc929c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.611039:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc929c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123208.611085:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789123208.611090:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789123208.611112:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc929c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.611125:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc929c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.611134:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc929ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.611141:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc929ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.611149:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc929ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.611156:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a200 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123208.611160:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc929ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.611168:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc929ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.611182:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:2.0:1789123208.611346:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123208.611607:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc929ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.611616:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc929ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.611661:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc929c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.611668:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc929c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.611674:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc929c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.611680:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123208.611684:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc929c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.611690:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc929c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.611700:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f34232f7100) 00010000:00010000:2.0:1789123208.611703:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123208.611705:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc929c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.611712:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc929c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.611758:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32e00/0x7e1648d68fc929b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f89f expref: 61 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.611789:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc929c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f89f expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.611798:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:2.0:1789123208.611801:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789123208.611803:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80a400, rc 0) 00000100:00100000:2.0:1789123208.611944:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+60:11811:x1876031364492032:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 1379us (1555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123208.611954:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 211 00000100:00100000:2.0:1789123208.617846:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123208.617897:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123208.617995:0:11614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364492160 00000100:00100000:0.0:1789123208.618007:0:11614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364492160 00000100:00100000:0.0:1789123208.618078:0:11614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 15 00000100:00100000:0.0:1789123208.618087:0:11614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+60:2354:x1876031364492160:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789123208.618102:0:11614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123208.618132:0:11614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a400/0x7e1648d68fc929c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f89f expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.618154:0:11614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:0.0:1789123208.618160:0:11614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123208.618219:0:11614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+59:2354:x1876031364492160:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 133us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123208.618237:0:11614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 15 00000100:00100000:1.0:1789123208.618544:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364492416 00000100:00100000:1.0:1789123208.618551:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364492416 00000100:00100000:1.0:1789123208.618597:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 212 00000100:00100000:1.0:1789123208.618605:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+59:11811:x1876031364492416:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1789123208.618648:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123208.618669:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc929cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f8a6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.618855:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc929d6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.618871:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc9299e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f891 expref: 60 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.618881:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc929d6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.618922:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc9299e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f891 expref: 60 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.618936:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc9299e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f891 expref: 60 pid: 7640 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123208.618950:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34063b4780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876031381258368:192.168.206.30@tcp:104: 00000100:00100000:0.0:1789123208.619021:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3435910a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789123208.622720:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34063b4780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876031381258368:192.168.206.30@tcp:104: 00010000:00010000:0.0:1789123208.622768:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc929d6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123208.622866:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123208.623142:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364492544 00000100:00100000:0.0:1789123208.623152:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364492544 00010000:00010000:0.0:1789123208.623251:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc9299e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f891 expref: 61 pid: 7640 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123208.623346:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 85 00000100:00100000:0.0:1789123208.623370:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+61:2355:x1876031364492544:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789123208.623390:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123208.623397:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc9299e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f891 expref: 61 pid: 7640 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.623411:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc9299e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f891 expref: 61 pid: 7640 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.623439:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33400/0x7e1648d68fc9299e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f891 expref: 61 pid: 7640 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.623457:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:0.0:1789123208.623464:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc929d6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.623474:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc929d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.623483:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc929d6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.623522:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123208.623597:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+60:2355:x1876031364492544:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 228us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123208.623606:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 85 00010000:00010000:1.0:1789123208.623691:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc929d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.623700:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc929d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123208.623722:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789123208.623907:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc929cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8a6 expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.623922:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc929d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8a6 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.623929:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:1.0:1789123208.623931:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789123208.623934:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b52600, rc 0) 00000100:00100000:1.0:1789123208.623962:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+60:11811:x1876031364492416:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 5359us (6131us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1789123208.623970:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 212 00000100:00100000:3.0:1789123208.627379:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123208.627578:0:11614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364492800 00000100:00100000:0.0:1789123208.627873:0:11614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364492800 00000100:00100000:0.0:1789123208.628008:0:11614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 16 00000100:00100000:0.0:1789123208.628020:0:11614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+60:11811:x1876031364492800:12345-192.168.206.30@tcp:103:lfs.0 00010000:00010000:0.0:1789123208.628058:0:11614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123208.628089:0:11614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ae00/0x7e1648d68fc92935 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f87c expref: 60 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.628110:0:11614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:0.0:1789123208.628116:0:11614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123208.628200:0:11614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+59:11811:x1876031364492800:12345-192.168.206.30@tcp:103:lfs.0 Request processed in 182us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123208.628208:0:11614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 16 00000100:00100000:2.0:1789123208.632969:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123208.633049:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364492928 00000100:00100000:1.0:1789123208.633061:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364492928 00000100:00100000:1.0:1789123208.633126:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 213 00000100:00100000:1.0:1789123208.633134:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+59:11811:x1876031364492928:12345-192.168.206.30@tcp:58:lfs.0 00010000:00010000:1.0:1789123208.633295:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc929e4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.633314:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc929e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.633332:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc929e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789123208.633550:0:7640:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1789123208.633972:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+59:11811:x1876031364492928:12345-192.168.206.30@tcp:58:lfs.0 Request processed in 833us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123208.633984:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 213 00000100:00100000:3.0:1789123208.638683:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123208.638836:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364493056 00000100:00100000:0.0:1789123208.638849:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364493056 00000100:00100000:0.0:1789123208.638924:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 214 00000100:00100000:0.0:1789123208.638937:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+59:11811:x1876031364493056:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:0.0:1789123208.638962:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123208.638988:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52000/0x7e1648d68fc929eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f8ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.639058:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc929e4 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.639070:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52000/0x7e1648d68fc929eb lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8ad expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.639093:0:5842:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc929e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.639110:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52000/0x7e1648d68fc929eb lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8ad expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.639144:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:0.0:1789123208.639147:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789123208.639152:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52000/0x7e1648d68fc929eb lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8ad expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.639161:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b52000, rc 0) 00000100:00100000:0.0:1789123208.639240:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+60:11811:x1876031364493056:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 305us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123208.639248:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 214 00000040:00080000:3.0:1789123208.708939:0:12081:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789123208.708950:0:12081:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789123208.709021:0:12081:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00010000:00010000:0.0:1789123208.709024:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789123208.709028:0:12081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789123208.709140:0:12081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c30b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12081:1876031381258496:192.168.206.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789123208.709284:0:12081:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f33012ea540 going to sleep for 11 seconds 00000100:00100000:2.0:1789123208.720773:0:12081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c30b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12081:1876031381258496:192.168.206.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789123208.723818:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123208.724026:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364493184 00000100:00100000:0.0:1789123208.724039:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364493184 00000100:00100000:0.0:1789123208.724115:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 215 00000100:00100000:0.0:1789123208.724128:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+60:11812:x1876031364493184:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789123208.724183:0:5840:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789123208.724327:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+60:11812:x1876031364493184:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 Request processed in 200us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123208.724336:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 215 00000100:00100000:3.0:1789123208.726357:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123208.726451:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364493312 00000100:00100000:0.0:1789123208.726462:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364493312 00000100:00100000:0.0:1789123208.726518:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 216 00000100:00100000:0.0:1789123208.726528:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c309680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+60:11812:x1876031364493312:12345-192.168.206.30@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789123208.726688:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc929f2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.726716:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc929f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.726726:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc929f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.726739:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc929f9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.726744:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc929f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.726748:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc929f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.726769:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92a00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.726774:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92a00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.726780:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92a00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123208.726826:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789123208.726832:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789123208.726846:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92a00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.726859:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc929f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.726875:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc929f2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.726882:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc929f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.726889:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52800 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123208.726893:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc929f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.726902:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc929f2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.726917:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f3411751e00) 00010000:00010000:0.0:1789123208.726920:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123208.726926:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc929f2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.726932:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc929f2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.726943:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc929f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.726946:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc929f9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.726951:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc929f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.726954:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53e00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123208.726960:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc929f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.726965:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc929f9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.726970:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9f34226c1500) 00010000:00010000:0.0:1789123208.726972:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123208.726974:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc929f9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.726978:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc929f9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.726989:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92a00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.726992:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92a00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.726995:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92a00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.726999:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53a00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123208.727001:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92a00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.727004:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92a00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.727007:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:0.0:1789123208.727009:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123208.727014:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92a00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.727018:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92a00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123208.727266:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c309680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+60:11812:x1876031364493312:12345-192.168.206.30@tcp:34:lhsmtool_posix.0 Request processed in 737us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123208.727287:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 216 00000100:00100000:0.0:1789123208.730426:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123208.730547:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364493568 00000100:00100000:2.0:1789123208.730563:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364493568 00000100:00100000:2.0:1789123208.730662:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 217 00000100:00100000:2.0:1789123208.730673:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+60:11812:x1876031364493568:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789123208.730700:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123208.730728:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92a07 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f8b4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.730848:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92a0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.730883:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92a0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.730897:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92a0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123208.730913:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789123208.731039:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92a0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.731047:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92a0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.731054:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92a0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.731060:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80b600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123208.731065:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92a0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.731074:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92a0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.731089:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:2.0:1789123208.731092:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789123208.731098:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92a0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.731105:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b600/0x7e1648d68fc92a0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.731157:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92a07 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8b4 expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.731176:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f3411751e00) 00010000:00010000:2.0:1789123208.731179:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789123208.731183:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92a07 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8b4 expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.731193:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80bc00, rc 0) 00000100:00100000:2.0:1789123208.731289:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+61:11812:x1876031364493568:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 617us (875us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1789123208.731297:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 217 00000100:00100000:2.0:1789123208.736186:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123208.736501:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364493696 00000100:00100000:1.0:1789123208.736514:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364493696 00000100:00100000:1.0:1789123208.736587:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 218 00000100:00100000:1.0:1789123208.736600:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+61:11812:x1876031364493696:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789123208.736693:0:5841:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789123208.736838:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+61:11812:x1876031364493696:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 Request processed in 241us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123208.736847:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 218 00000100:00100000:3.0:1789123208.741163:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123208.741484:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364493952 00000100:00100000:1.0:1789123208.741496:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364493952 00000100:00100000:1.0:1789123208.742013:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 219 00000100:00100000:1.0:1789123208.742028:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+61:11812:x1876031364493952:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789123208.742054:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123208.742058:0:7640:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789123208.742095:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32a00/0x7e1648d68fc929ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f898 expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.742117:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:1.0:1789123208.742124:0:7640:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789123208.742157:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc92a1c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f8bb expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789123208.742885:0:7640:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:1.0:1789123208.743129:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc92a23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.743148:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc92a23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.743160:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc92a23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.743234:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32200/0x7e1648d68fc92a1c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8bb expref: 63 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.743253:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc92a23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8bb expref: 62 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.743263:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f340534d800) 00010000:00010000:1.0:1789123208.743265:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789123208.743279:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd33800, rc 0) 00000100:00100000:1.0:1789123208.743368:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+62:11812:x1876031364493952:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 1343us (2219us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1789123208.743378:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 219 00000100:00100000:3.0:1789123208.747187:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123208.747321:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364494208 00000100:00100000:1.0:1789123208.747335:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364494208 00000100:00100000:1.0:1789123208.747425:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 220 00000100:00100000:1.0:1789123208.747437:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+62:11812:x1876031364494208:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789123208.747533:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123208.747568:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33800/0x7e1648d68fc92a23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8bb expref: 62 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.747589:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f340534d800) 00010000:00010000:1.0:1789123208.747602:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789123208.747682:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92a31 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.747701:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92a31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.747718:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92a31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.752520:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92a38 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x3d1cfc1f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.752543:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92a38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3d1cfc1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.752558:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92a38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3d1cfc1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.752729:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92a31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.752737:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92a31 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.752744:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92a31 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.752766:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123208.752771:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92a31 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.752778:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92a31 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.752792:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:1.0:1789123208.752795:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123208.752799:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92a31 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.752806:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92a31 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.752820:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92a38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3d1cfc1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.753246:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92a38 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3d1cfc1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.753254:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92a38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3d1cfc1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.753258:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33c00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123208.753262:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92a38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3d1cfc1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.753278:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92a38 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3d1cfc1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.753300:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x3d1cfc1f (ffff9f340534d700) 00010000:00010000:1.0:1789123208.753303:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123208.753306:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92a38 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3d1cfc1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.753312:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92a38 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3d1cfc1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123208.753424:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+61:11812:x1876031364494208:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 5986us (6258us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789123208.753434:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 220 00000100:00100000:2.0:1789123208.758511:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123208.758677:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364494336 00000100:00100000:0.0:1789123208.758688:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364494336 00000100:00100000:0.0:1789123208.758741:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 221 00000100:00100000:0.0:1789123208.758752:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+61:11812:x1876031364494336:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789123208.758771:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123208.758793:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92a3f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f8c2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.758842:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92a46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.758857:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92a46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.758868:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92a46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.758981:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92a3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8c2 expref: 63 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.759261:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92a46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8c2 expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.759282:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f34226c1500) 00010000:00010000:0.0:1789123208.759285:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789123208.759289:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53e00, rc 0) 00000100:00100000:0.0:1789123208.759357:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+62:11812:x1876031364494336:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 608us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123208.759365:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 221 00000100:00100000:3.0:1789123208.764853:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123208.764952:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364494592 00000100:00100000:0.0:1789123208.764961:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364494592 00000100:00100000:0.0:1789123208.765014:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 222 00000100:00100000:0.0:1789123208.765034:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340493a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+62:11812:x1876031364494592:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789123208.765113:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92a4d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.765130:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92a4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.765142:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92a4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789123208.765397:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:0.0:1789123208.765495:0:5842:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000001acface7 reply state 000000000208e9bf transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92a4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123208.765505:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789123208.765614:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340493a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+64:11812:x1876031364494592:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 582us (770us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1789123208.765622:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 222 00010000:00010000:2.0:1789123208.768413:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92a4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.768430:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92a4d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.768439:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92a4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.768723:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52800 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123208.768730:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92a4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.768742:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92a4d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.768761:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f34226c1500) 00010000:00010000:2.0:1789123208.768780:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789123208.768785:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92a4d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.768792:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc92a4d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123208.769045:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123208.769158:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364494720 00000100:00100000:0.0:1789123208.769175:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364494720 00000100:00100000:0.0:1789123208.769251:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 223 00000100:00100000:0.0:1789123208.769263:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d32a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+63:11812:x1876031364494720:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789123208.769310:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123208.769340:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc92a54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f8c9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.769434:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc92a54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8c9 expref: 64 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.769451:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc92a54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8c9 expref: 64 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.769478:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f34226c1500) 00010000:00010000:0.0:1789123208.769482:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789123208.769486:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b52c00, rc 0) 00000100:00100000:0.0:1789123208.769565:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d32a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+64:11812:x1876031364494720:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 303us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123208.769575:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 223 00000100:00100000:3.0:1789123208.773881:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123208.774030:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364494848 00000100:00100000:1.0:1789123208.774046:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364494848 00000100:00100000:1.0:1789123208.774501:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 62 00000100:00100000:1.0:1789123208.774516:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355fe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+9:2355:x1876031364494848:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789123208.774930:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355fe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+10:2355:x1876031364494848:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 Request processed in 417us (1058us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1789123208.774939:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 62 00000100:00080000:2.0:1789123208.775231:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789123208.778416:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123208.778904:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364495104 00000100:00100000:1.0:1789123208.778919:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364495104 00000100:00100000:1.0:1789123208.778988:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 60 00000100:00100000:1.0:1789123208.779002:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+64:11812:x1876031364495104:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789123208.779437:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+65:11812:x1876031364495104:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 Request processed in 437us (1033us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1789123208.779447:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 60 00000100:00100000:3.0:1789123208.782838:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123208.782918:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364495360 00000100:00100000:0.0:1789123208.782931:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364495360 00000100:00100000:0.0:1789123208.783006:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 224 00000100:00100000:0.0:1789123208.783019:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+65:11812:x1876031364495360:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789123208.783266:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+65:11812:x1876031364495360:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 171us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123208.783287:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 224 00000100:00100000:3.0:1789123208.785924:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123208.786033:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364495488 00000100:00100000:0.0:1789123208.786044:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364495488 00000100:00100000:0.0:1789123208.786513:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 225 00000100:00100000:0.0:1789123208.786526:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+65:11812:x1876031364495488:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789123208.786554:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123208.786728:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92a5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f8d0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.786849:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc92a62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.786869:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc92a62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.786884:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc92a62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123208.786934:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789123208.786956:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc92a62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.786985:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc92a5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8d0 expref: 67 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.787004:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc92a62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8d0 expref: 66 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.787025:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f34226c1500) 00010000:00010000:0.0:1789123208.787028:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789123208.787032:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53800, rc 0) 00000100:00100000:0.0:1789123208.787546:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+66:11812:x1876031364495488:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 1017us (1627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123208.787557:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 225 00000100:00100000:2.0:1789123208.797594:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123208.797794:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364495616 00000100:00100000:3.0:1789123208.797807:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364495616 00000100:00100000:3.0:1789123208.797889:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 63 00000100:00100000:3.0:1789123208.797902:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34048a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+10:2354:x1876031364495616:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789123208.797928:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123208.797957:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc92a69 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f8d7 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789123208.797995:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3da88, blocks: 0x1 00010000:00010000:3.0:1789123208.798024:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=323s v=(0 0) 00010000:00010000:3.0:1789123208.798030:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789123208.798041:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc92a69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8d7 expref: 11 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.798063:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc92a69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8d7 expref: 11 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.798080:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbb600, rc 0) 00000100:00100000:3.0:1789123208.798400:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34048a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+11:2354:x1876031364495616:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 277us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123208.798425:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 63 00000100:00100000:3.0:1789123208.803306:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123208.803592:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364495872 00000100:00100000:1.0:1789123208.803606:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364495872 00000100:00100000:0.0:1789123208.803712:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 226 00000100:00100000:0.0:1789123208.803728:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+66:11812:x1876031364495872:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789123208.803884:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+66:11812:x1876031364495872:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 160us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123208.803893:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 226 00000100:00100000:2.0:1789123208.807368:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123208.807473:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364496000 00000100:00100000:0.0:1789123208.807485:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364496000 00000100:00100000:0.0:1789123208.807553:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 64 00000100:00100000:0.0:1789123208.807564:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34048a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+11:11812:x1876031364496000:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789123208.807594:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123208.807617:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e74ed8fc/0x7e1648d68fc92a70 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f8de expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.807685:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc92a69 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8d7 expref: 12 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.807696:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123208.807700:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123208.807718:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e74ed8fc/0x7e1648d68fc92a70 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8de expref: 12 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.807762:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc92a69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8d7 expref: 12 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.807778:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc92a69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8d7 expref: 12 pid: 6688 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123208.807795:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d768b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1876031381258624:192.168.206.30@tcp:104: 00000100:00100000:0.0:1789123208.807914:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3435910180 going to sleep for 11 seconds 00000100:00100000:2.0:1789123208.811015:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123208.811113:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364496128 00000100:00100000:3.0:1789123208.811125:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364496128 00000100:00100000:0.0:1789123208.811316:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d768b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1876031381258624:192.168.206.30@tcp:104: 00010000:00010000:0.0:1789123208.811358:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e74ed8fc/0x7e1648d68fc92a70 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8de expref: 13 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.811383:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53a00, rc 0) 00000100:00100000:0.0:1789123208.811497:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34048a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+13:11812:x1876031364496000:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 3934us (4141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123208.811507:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 64 00010000:00010000:3.0:1789123208.811577:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc92a69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8d7 expref: 12 pid: 6688 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123208.811619:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 86 00000100:00100000:3.0:1789123208.811676:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34048a3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+12:2355:x1876031364496128:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789123208.811694:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123208.811724:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc92a69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8d7 expref: 12 pid: 6688 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.811739:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc92a69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8d7 expref: 12 pid: 6688 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.811766:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc92a69 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8d7 expref: 12 pid: 6688 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.811782:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789123208.811788:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789123208.811798:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e74ed8fc/0x7e1648d68fc92a70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8de expref: 11 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.811809:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e74ed8fc/0x7e1648d68fc92a70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8de expref: 11 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.811865:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e74ed8fc/0x7e1648d68fc92a70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8de expref: 11 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123208.811881:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355fc780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876031381258752:192.168.206.30@tcp:105: 00000100:00100000:3.0:1789123208.811947:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f33012ea9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123208.816993:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355fc780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876031381258752:192.168.206.30@tcp:105: 00010000:00010000:1.0:1789123208.817032:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789123208.817119:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34048a3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+11:2355:x1876031364496128:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 5489us (6116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123208.817134:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 86 00000100:00100000:3.0:1789123208.818470:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123208.818567:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364496256 00000100:00100000:1.0:1789123208.818578:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364496256 00002000:00100000:1.0:1789123208.818664:0:6691:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9f34355ffc00 x1876031364496256/t0(0) o4->64de9449-4320-4c9f-abcb-230edd2b11ae@192.168.206.30@tcp:474/0 lens 504/0 e 0 to 0 dl 1789123219 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789123208.818678:0:6691:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9f34355ffc00 with x1876031364496256 ext(0->12) 00002000:00010000:1.0:1789123208.818685:0:6691:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f34355ffc00 00000100:00100000:1.0:1789123208.818716:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 6 00000100:00100000:1.0:1789123208.818726:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+11:2352:x1876031364496256:12345-192.168.206.30@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789123208.819453:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+13:2352:x1876031364496256:12345-192.168.206.30@tcp:4:lhsmtool_posix.0 Request processed in 724us (988us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1789123208.819464:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 6 00002000:00100000:1.0:1789123208.819473:0:6691:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9f34355ffc00 x1876031364496256/t4294967320(0) o4->64de9449-4320-4c9f-abcb-230edd2b11ae@192.168.206.30@tcp:474/0 lens 504/448 e 0 to 0 dl 1789123219 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789123208.819483:0:6691:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9f34355ffc00 with x1876031364496256 ext(0->12) 00002000:00010000:1.0:1789123208.819487:0:6691:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f34355ffc00 00000100:00100000:2.0:1789123208.822862:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123208.822951:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364496384 00000100:00100000:1.0:1789123208.822963:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364496384 00000100:00100000:1.0:1789123208.823028:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 227 00000100:00100000:1.0:1789123208.823039:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34048a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+66:11812:x1876031364496384:12345-192.168.206.30@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789123208.861927:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:2.0:1789123208.861961:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000100:00100000:2.0:1789123208.862441:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381258880:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789123208.862539:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123208.862886:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381258880 00000100:00100000:3.0:1789123208.862897:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381258880 00000100:00100000:3.0:1789123208.862974:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789123208.862985:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34048a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1876031381258880:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789123208.863022:0:6688:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:3.0:1789123208.863051:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc92a77 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.863078:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000962933c8/0x7e1648d68fc92839 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f83d expref: 12 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.863099:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789123208.863105:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789123208.863110:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc92a77 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.863146:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000962933c8/0x7e1648d68fc92839 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f83d expref: 12 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789123208.864095:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789123208.864577:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000962933c8/0x7e1648d68fc92839 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f83d expref: 12 pid: 6687 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123208.864764:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355fed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1876031381259008:192.168.206.30@tcp:104: 00000100:00100000:3.0:1789123208.864917:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f33012ea9c0 going to sleep for 11 seconds 00000001:00080000:3.0:1789123208.865341:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1789123208.865416:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1789123208.865442:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f3413026240 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1789123208.865447:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f3301245500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f3413026f00 00000020:00080000:3.0:1789123208.865450:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f3301245000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f342d88e000 00000020:00080000:3.0:1789123208.865477:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f3303e6cf00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1789123208.865480:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f3301245e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f3303e6c600 00000020:00080000:3.0:1789123208.865484:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f3301245100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f3301303000 00000020:00080000:3.0:1789123208.865497:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1789123208.865514:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1789123208.865794:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789123208.866495:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34048a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+20:11812:x1876031364496384:12345-192.168.206.30@tcp:44:lhsmtool_posix.0 Request processed in 43451us (43640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123208.866509:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 227 00000100:00100000:3.0:1789123208.866671:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d768b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381259136:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789123208.866738:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123208.866840:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381259136 00000100:00100000:1.0:1789123208.866848:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381259136 00000100:00100000:1.0:1789123208.866899:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789123208.866910:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1876031381259136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789123208.866942:0:6687:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1789123208.866989:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa3da87, atime: 0x6aa3da88, ctime: 0x6aa3da87, blocks: 0x1 00010000:00010000:1.0:1789123208.866998:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038025a92/0x7e1648d68fc92a7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.867018:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=323s v=(0 0) 00010000:00010000:1.0:1789123208.867023:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123208.867031:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038025a92/0x7e1648d68fc92a7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.867051:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038025a92/0x7e1648d68fc92a7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.867063:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038025a92/0x7e1648d68fc92a7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.867072:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038025a92/0x7e1648d68fc92a7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.867412:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789123208.867683:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789123208.867693:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038025a92/0x7e1648d68fc92a7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.867703:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32400 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:0.0:1789123208.867710:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038025a92/0x7e1648d68fc92a7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.867733:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038025a92/0x7e1648d68fc92a7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.867755:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038025a92/0x7e1648d68fc92a7e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.867764:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038025a92/0x7e1648d68fc92a7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.867788:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123208.867790:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123208.867792:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123208.869701:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3305:x1876031381259136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2781us (2951us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789123208.869717:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:3.0:1789123208.873903:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f342d768b40/2, rc 0, transno 4294967310 00000100:00100000:3.0:1789123208.873924:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d768b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381259136:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789123208.874445:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123208.874568:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123208.874684:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355fed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1876031381259008:192.168.206.30@tcp:104: 00010000:00010000:0.0:1789123208.874715:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc92a77 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123208.874864:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364496640 00000100:00100000:2.0:1789123208.874873:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364496640 00010000:00010000:2.0:1789123208.874925:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000962933c8/0x7e1648d68fc92839 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f83d expref: 13 pid: 6687 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123208.874970:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 87 00000100:00100000:2.0:1789123208.874981:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063c9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+13:2354:x1876031364496640:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789123208.874999:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123208.875007:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000962933c8/0x7e1648d68fc92839 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f83d expref: 13 pid: 6687 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.875038:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000962933c8/0x7e1648d68fc92839 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f83d expref: 13 pid: 6687 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.875327:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000962933c8/0x7e1648d68fc92839 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f83d expref: 13 pid: 6687 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.875350:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789123208.875355:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789123208.875362:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc92a77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.875374:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc92a77 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.875410:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123208.875480:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063c9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+12:2354:x1876031364496640:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 500us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123208.875489:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 87 00010000:00010000:1.0:1789123208.877361:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc92a77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.877387:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc92a77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.877401:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc92a77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.877410:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc92a77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.877439:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789123208.877721:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789123208.877731:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc92a77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.877742:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbb600 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:0.0:1789123208.877748:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc92a77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.877759:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc92a77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.877797:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc92a77 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.877807:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc92a77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.877831:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123208.877833:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123208.877835:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123208.879081:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34048a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1876031381258880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16088us (16532us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1789123208.879106:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789123208.879141:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364496512 00000100:00100000:1.0:1789123208.879151:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364496512 00000100:00100000:3.0:1789123208.879454:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 67 00000100:00100000:3.0:1789123208.879469:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+12:2354:x1876031364496512:12345-192.168.206.30@tcp:16:lhsmtool_posix.0 00000004:00080000:2.0:1789123208.884752:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f34355ff840/2, rc 0, transno 4294967321 00000100:00100000:2.0:1789123208.884782:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381258880:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1789123208.922066:0:12782:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000001:00080000:3.0:1789123208.922093:0:12782:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:3.0:1789123208.922100:0:12782:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:1.0:1789123208.922543:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2354:x1876031364496512:12345-192.168.206.30@tcp:16:lhsmtool_posix.0 Request processed in 43068us (48092us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123208.922589:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 67 00000100:00100000:3.0:1789123208.926127:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123208.926206:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364496896 00000100:00100000:0.0:1789123208.926229:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364496896 00000100:00100000:0.0:1789123208.926312:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 228 00000100:00100000:0.0:1789123208.926324:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+20:11812:x1876031364496896:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789123208.926396:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123208.926432:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc92a62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8d0 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.926454:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f34226c1500) 00010000:00010000:0.0:1789123208.926460:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789123208.926501:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc92a85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.926520:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc92a85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.926533:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc92a85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789123208.926872:0:5842:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000041ee03a9 reply state 000000001f82e525 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc92a85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123208.926885:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789123208.927549:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+21:11812:x1876031364496896:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 1222us (1429us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1789123208.927559:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 228 00000100:00100000:3.0:1789123208.930360:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00010000:00010000:0.0:1789123208.930498:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc92a85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.930513:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc92a85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.930522:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc92a85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.930530:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53000 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123208.930535:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc92a85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.930545:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc92a85 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.930566:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f34226c1500) 00010000:00010000:0.0:1789123208.930569:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123208.930575:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc92a85 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.930582:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc92a85 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123208.930775:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364497024 00000100:00100000:1.0:1789123208.930787:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364497024 00000100:00100000:1.0:1789123208.930850:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 68 00000100:00100000:1.0:1789123208.930861:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c238050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2354:x1876031364497024:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789123208.931172:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789123208.931177:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789123208 00002000:00010000:1.0:1789123208.931179:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789123208 00002000:00010000:1.0:1789123208.931181:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789123208 -> 1789123208 00002000:00010000:1.0:1789123208.931184:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789123208.931376:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c238050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+8:2354:x1876031364497024:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 Request processed in 515us (1029us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1789123208.931385:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 68 00000100:00100000:1.0:1789123208.935434:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123208.935517:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364497280 00000100:00100000:2.0:1789123208.935530:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364497280 00000100:00100000:2.0:1789123208.935603:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 229 00000100:00100000:2.0:1789123208.935615:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+20:11812:x1876031364497280:12345-192.168.206.30@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789123208.935745:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc92a8c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.935765:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92a46 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8c2 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.935775:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc92a8c lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.935819:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92a46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8c2 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.935836:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92a46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8c2 expref: 20 pid: 5840 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123208.935853:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34048a3840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876031381259264:192.168.206.30@tcp:104: 00000100:00100000:2.0:1789123208.935958:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3403356780 going to sleep for 11 seconds 00000100:00100000:3.0:1789123208.938503:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34048a3840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876031381259264:192.168.206.30@tcp:104: 00010000:00010000:3.0:1789123208.938550:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc92a8c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123208.941980:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123208.942490:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364497408 00000100:00100000:0.0:1789123208.942502:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364497408 00010000:00010000:0.0:1789123208.942555:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92a46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8c2 expref: 21 pid: 5840 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123208.942610:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 88 00000100:00100000:0.0:1789123208.942622:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062da940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+21:2355:x1876031364497408:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789123208.942669:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123208.942677:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92a46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8c2 expref: 21 pid: 5840 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.942692:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92a46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8c2 expref: 21 pid: 5840 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.942723:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92a46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8c2 expref: 21 pid: 5840 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.942742:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f34226c1500) 00010000:00010000:0.0:1789123208.942749:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc92a8c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.942760:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc92a8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.942770:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc92a8c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.942802:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123208.942897:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062da940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+20:2355:x1876031364497408:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 276us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123208.942906:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 88 00010000:00010000:3.0:1789123208.943848:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc92a8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.943865:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc92a8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.943903:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc92a8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.943910:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc92a8c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.943918:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc92a8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.943924:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80ac00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123208.943929:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc92a8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.943937:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc92a8c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.943968:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f34226c1500) 00010000:00010000:3.0:1789123208.943971:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789123208.943977:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc92a8c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.943984:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80ac00/0x7e1648d68fc92a8c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123208.944058:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+19:11812:x1876031364497280:12345-192.168.206.30@tcp:55:lhsmtool_posix.0 Request processed in 8441us (8634us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789123208.944069:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 229 00000100:00100000:2.0:1789123208.947467:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123208.947807:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364497536 00000100:00100000:1.0:1789123208.947819:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364497536 00000100:00100000:1.0:1789123208.947919:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 69 00000100:00100000:1.0:1789123208.947932:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34048a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+8:2354:x1876031364497536:12345-192.168.206.30@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789123208.947990:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002b9cca8d/0x7e1648d68fc92a93 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.948015:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e74ed8fc/0x7e1648d68fc92a70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8de expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.948043:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123208.948049:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789123208.948054:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b9cca8d/0x7e1648d68fc92a93 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.948099:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e74ed8fc/0x7e1648d68fc92a70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8de expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.948115:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e74ed8fc/0x7e1648d68fc92a70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8de expref: 8 pid: 6686 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123208.948133:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c306940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1876031381259392:192.168.206.30@tcp:104: 00000100:00100000:1.0:1789123208.948346:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f341851c840 going to sleep for 11 seconds 00000100:00100000:1.0:1789123208.951425:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c306940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1876031381259392:192.168.206.30@tcp:104: 00010000:00010000:1.0:1789123208.951465:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002b9cca8d/0x7e1648d68fc92a93 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123208.952438:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123208.952703:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364497664 00000100:00100000:3.0:1789123208.952715:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364497664 00010000:00010000:3.0:1789123208.952774:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e74ed8fc/0x7e1648d68fc92a70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8de expref: 9 pid: 6686 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123208.952823:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 89 00000100:00100000:3.0:1789123208.952835:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34048a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+9:2355:x1876031364497664:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789123208.952856:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123208.952895:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e74ed8fc/0x7e1648d68fc92a70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8de expref: 9 pid: 6686 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.952910:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e74ed8fc/0x7e1648d68fc92a70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8de expref: 9 pid: 6686 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.952940:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e74ed8fc/0x7e1648d68fc92a70 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8de expref: 9 pid: 6686 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.952980:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789123208.952985:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789123208.952993:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002b9cca8d/0x7e1648d68fc92a93 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.953005:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b9cca8d/0x7e1648d68fc92a93 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.953112:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789123208.953197:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34048a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+8:2355:x1876031364497664:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 363us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123208.953206:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 89 00010000:00010000:1.0:1789123208.954283:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002b9cca8d/0x7e1648d68fc92a93 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.954300:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b9cca8d/0x7e1648d68fc92a93 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.954337:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002b9cca8d/0x7e1648d68fc92a93 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.954359:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b9cca8d/0x7e1648d68fc92a93 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.954369:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b9cca8d/0x7e1648d68fc92a93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.954378:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32200 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123208.954383:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b9cca8d/0x7e1648d68fc92a93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.954392:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b9cca8d/0x7e1648d68fc92a93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.954410:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b9cca8d/0x7e1648d68fc92a93 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.954419:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b9cca8d/0x7e1648d68fc92a93 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123208.954513:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34048a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2354:x1876031364497536:12345-192.168.206.30@tcp:1:lhsmtool_posix.0 Request processed in 6580us (7054us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123208.954523:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 69 00000100:00100000:2.0:1789123208.957063:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123208.957179:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364497920 00000100:00100000:0.0:1789123208.957191:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364497920 00000100:00100000:0.0:1789123208.957263:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 230 00000100:00100000:0.0:1789123208.957285:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34048a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+19:11812:x1876031364497920:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789123208.957388:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92a9a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.957409:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92a9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.957424:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92a9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.957750:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc92aa1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.957764:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc92a54 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8c9 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.957774:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc92aa1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.957816:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc92a54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8c9 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.957832:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc92a54 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8c9 expref: 20 pid: 5840 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123208.957869:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d76a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876031381259520:192.168.206.30@tcp:104: 00000100:00100000:0.0:1789123208.957977:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3435910e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789123208.961515:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123208.961606:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364498048 00000100:00100000:3.0:1789123208.961618:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364498048 00010000:00010000:3.0:1789123208.961705:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc92a54 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8c9 expref: 21 pid: 5840 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123208.961749:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 90 00000100:00100000:3.0:1789123208.961760:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34048a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+21:2354:x1876031364498048:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789123208.961779:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123208.961787:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc92a54 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8c9 expref: 21 pid: 5840 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.961801:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc92a54 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8c9 expref: 21 pid: 5840 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.961847:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f34226c1500) 00010000:00010000:3.0:1789123208.961853:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc92aa1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.961864:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc92aa1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.961873:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc92aa1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123208.961896:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789123208.961959:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34048a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+21:2354:x1876031364498048:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 200us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123208.961968:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 90 00010000:00010000:0.0:1789123208.962445:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc92a54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8c9 expref: 20 pid: 5840 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123208.962466:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d76a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876031381259520:192.168.206.30@tcp:104: 00010000:00010000:0.0:1789123208.962493:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc92aa1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.962503:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc92aa1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.962510:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc92aa1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789123208.962780:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1789123208.962952:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1789123208.963002:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1789123208.963107:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d76a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1876031381259648:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789123208.963194:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123208.963233:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3435910240 going to sleep for 11 seconds 00000100:00100000:1.0:1789123208.963337:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381259648 00000100:00100000:1.0:1789123208.963345:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381259648 00000100:00100000:1.0:1789123208.963395:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789123208.963418:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34356730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1876031381259648:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789123208.963498:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34356730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1876031381259648:12345-0@lo:1000:mdt00_001.0 Request processed in 82us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123208.963506:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789123208.963586:0:5841:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1789123208.963594:0:5841:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:2.0:1789123208.963614:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f34355ff840, transno 4294967321 00000100:00100000:2.0:1789123208.963657:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d76a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1876031381259648:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1789123208.964150:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1789123208.964220:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34048a1e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1876031381259776:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789123208.964286:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123208.964310:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3403356780 going to sleep for 11 seconds 00000100:00100000:1.0:1789123208.964474:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381259776 00000100:00100000:1.0:1789123208.964481:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381259776 00000100:00100000:1.0:1789123208.964514:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789123208.964522:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34048a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1876031381259776:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789123208.964754:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34048a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1876031381259776:12345-0@lo:1000:mdt00_001.0 Request processed in 231us (466us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1789123208.964761:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789123208.966344:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34048a1e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1876031381259776:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1789123208.966400:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc92aa1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.966413:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc92aa1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.966421:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc92aa1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.966428:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53000 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123208.966434:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc92aa1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.966443:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc92aa1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.966462:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f34226c1500) 00010000:00010000:2.0:1789123208.966466:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789123208.966472:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc92aa1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.966478:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53000/0x7e1648d68fc92aa1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.966518:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc929e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.966526:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc929e4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.966547:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc929e4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.966553:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32c00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123208.966556:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc929e4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.966562:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc929e4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.966571:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:2.0:1789123208.966574:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789123208.966597:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52000/0x7e1648d68fc929eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8ad expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.966611:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52000/0x7e1648d68fc929eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8ad expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.966622:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52000/0x7e1648d68fc929eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8ad expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123208.966845:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52000/0x7e1648d68fc929eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8ad expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123208.966863:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34048a2940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876031381259904:192.168.206.30@tcp:105: 00000100:00100000:2.0:1789123208.966980:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3403356780 going to sleep for 11 seconds 00000100:00100000:0.0:1789123208.969764:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34048a2940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876031381259904:192.168.206.30@tcp:105: 00010000:00010000:0.0:1789123208.969805:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc929e4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.969818:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32c00/0x7e1648d68fc929e4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.969879:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc92aa8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.969897:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc92aa8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.969912:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc92aa8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.969924:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc92aa8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.969931:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc92aa8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.969938:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc92aa8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.969945:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53800 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123208.969950:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc92aa8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.969958:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc92aa8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.969972:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:0.0:1789123208.969975:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123208.969980:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc92aa8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.969987:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53800/0x7e1648d68fc92aa8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.970005:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92a9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.970012:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92a9a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.970019:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92a9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.970025:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53e00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123208.970028:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92a9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.970034:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92a9a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.970041:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:0.0:1789123208.970044:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789123208.970046:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92a9a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.970052:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92a9a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123208.970379:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34048a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+23:11812:x1876031364497920:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 13093us (13325us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1789123208.970391:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 230 00000020:00080000:0.0:1789123208.970399:0:5841:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789123208.970803:0:12081:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789123208.970810:0:12081:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789123208.971415:0:12081:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789123208.971426:0:12081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789123208.972597:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123208.973911:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364498176 00000100:00100000:0.0:1789123208.973931:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364498176 00000100:00100000:0.0:1789123208.974012:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 61 00000100:00100000:0.0:1789123208.974023:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+23:11811:x1876031364498176:12345-192.168.206.30@tcp:49:lfs.0 00000100:00100000:0.0:1789123208.974216:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+23:11811:x1876031364498176:12345-192.168.206.30@tcp:49:lfs.0 Request processed in 193us (1637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123208.974225:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 61 00000100:00100000:3.0:1789123208.977753:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123208.977880:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364498432 00000100:00100000:0.0:1789123208.977893:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364498432 00000100:00100000:0.0:1789123208.977963:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 62 00000100:00100000:0.0:1789123208.977976:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427aba850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+23:11812:x1876031364498432:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789123208.978903:0:5844:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789123208.979024:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1789123208.979082:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92aaf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.979104:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92aaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.979119:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92aaf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.979129:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92aaf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.979135:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92aaf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.979141:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92aaf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123208.979160:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789123208.979529:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789123208.979539:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92aaf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.979549:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52a00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123208.979553:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92aaf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.979563:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92aaf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.979580:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f34226c1300) 00010000:00010000:1.0:1789123208.979583:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789123208.979589:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92aaf lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.979596:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92aaf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123208.979645:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123208.979647:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123208.979648:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123208.979737:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427aba850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+25:11812:x1876031364498432:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 Request processed in 1758us (1993us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1789123208.979748:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 62 00000020:00080000:0.0:1789123208.979755:0:5844:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789123208.981684:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123208.981796:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364498688 00000100:00100000:1.0:1789123208.981808:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364498688 00000100:00100000:1.0:1789123208.981880:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 231 00000100:00100000:1.0:1789123208.981891:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34048a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+25:11811:x1876031364498688:12345-192.168.206.30@tcp:58:lfs.0 00000040:00080000:1.0:1789123208.982229:0:7640:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1789123208.982345:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34048a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+25:11811:x1876031364498688:12345-192.168.206.30@tcp:58:lfs.0 Request processed in 455us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123208.982355:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 231 00000100:00100000:2.0:1789123209.010373:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123209.010508:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364498816 00000100:00100000:3.0:1789123209.010521:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364498816 00000100:00100000:3.0:1789123209.010618:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 232 00000100:00100000:3.0:1789123209.010671:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34048a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+25:11814:x1876031364498816:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:3.0:1789123209.010704:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123209.010733:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc92ab6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f8e5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123209.010816:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92abd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123209.010835:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92abd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123209.010863:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92abd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123209.010897:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92ac4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123209.010906:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123209.010914:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789123209.011500:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789123209.011711:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbac00/0x7e1648d68fc92acb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123209.011728:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc929d6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8a6 expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123209.011738:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbac00/0x7e1648d68fc92acb lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123209.011784:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc929d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8a6 expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123209.011802:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc929d6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8a6 expref: 26 pid: 5841 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123209.011819:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355fcb40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876031381260032:192.168.206.30@tcp:104: 00000100:00100000:3.0:1789123209.011930:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408def780 going to sleep for 11 seconds 00000100:00100000:2.0:1789123209.027126:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123209.027484:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364499072 00000100:00100000:0.0:1789123209.027498:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364499072 00000100:00100000:0.0:1789123209.027577:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 63 00000100:00100000:0.0:1789123209.027597:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34048a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+27:5590:x1876031364499072:12345-192.168.206.30@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789123209.027934:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34048a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+28:5590:x1876031364499072:12345-192.168.206.30@tcp:35:ldlm_bl.0 Request processed in 338us (820us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1789123209.027942:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 63 00000100:00100000:3.0:1789123209.029288:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355fcb40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876031381260032:192.168.206.30@tcp:104: 00010000:00010000:3.0:1789123209.029333:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbac00/0x7e1648d68fc92acb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123209.033153:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123209.036614:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364499200 00000100:00100000:3.0:1789123209.036805:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364499200 00010000:00010000:0.0:1789123209.037770:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc929d6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8a6 expref: 28 pid: 5841 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123209.037833:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 91 00000100:00100000:0.0:1789123209.037845:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34048a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+28:2355:x1876031364499200:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789123209.037867:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123209.037877:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc929d6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8a6 expref: 28 pid: 5841 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123209.037893:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc929d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8a6 expref: 28 pid: 5841 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123209.037925:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc929d6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8a6 expref: 28 pid: 5841 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123209.037945:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:0.0:1789123209.037969:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbac00/0x7e1648d68fc92acb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123209.037992:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbac00/0x7e1648d68fc92acb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123209.038001:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbac00/0x7e1648d68fc92acb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123209.038193:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbac00/0x7e1648d68fc92acb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123209.038203:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbac00/0x7e1648d68fc92acb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123209.038275:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789123209.038281:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789123209.038306:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbac00/0x7e1648d68fc92acb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123209.038326:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbac00/0x7e1648d68fc92acb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123209.038337:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92abd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123209.038344:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92abd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123209.038351:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92abd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123209.038357:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbbc00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123209.038361:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92abd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123209.038382:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92abd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123209.038393:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:3.0:1789123209.038396:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123209.038401:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92abd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123209.038406:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbbc00/0x7e1648d68fc92abd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123209.038418:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123209.038424:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92ac4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123209.038430:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92ac4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123209.038435:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbae00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123209.038438:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92ac4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123209.038445:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92ac4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123209.038452:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f3411751a00) 00010000:00010000:3.0:1789123209.038455:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123209.038457:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92ac4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123209.038474:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92ac4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123209.038518:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbb800/0x7e1648d68fc92ab6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8e5 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123209.038520:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789123209.038538:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbac00/0x7e1648d68fc92acb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8e5 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123209.038546:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:3.0:1789123209.038549:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789123209.038553:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbac00, rc 0) 00000100:00100000:0.0:1789123209.038759:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34048a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+27:2355:x1876031364499200:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 908us (5611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123209.038773:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 91 00000100:00100000:3.0:1789123209.040155:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34048a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+26:11814:x1876031364498816:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 29514us (29785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123209.040169:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 232 00000100:00100000:2.0:1789123209.125281:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123209.125339:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123209.125385:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123209.125507:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364499328 00000100:00100000:1.0:1789123209.125517:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364499328 00000100:00100000:1.0:1789123209.125571:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 323 00000100:00100000:1.0:1789123209.125581:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+13:2354:x1876031364499328:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1789123209.125739:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364499584 00000100:00100000:2.0:1789123209.125743:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364499584 00000100:00080000:2.0:1789123209.125766:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789123209.125800:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 163 00000100:00100000:2.0:1789123209.125808:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34048a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2354:x1876031364499584:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1789123209.125867:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34048a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2354:x1876031364499584:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 60us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123209.125874:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 163 00000100:00100000:1.0:1789123209.126366:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:19924a15-1c73-4644-a9ca-864666412d45+13:2354:x1876031364499328:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 783us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123209.126374:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 323 00000100:00100000:0.0:1789123209.126754:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364499456 00000100:00100000:0.0:1789123209.126761:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364499456 00000100:00100000:0.0:1789123209.126796:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 82 00000100:00100000:0.0:1789123209.126805:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34048a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2354:x1876031364499456:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123209.126836:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34048a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2354:x1876031364499456:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 33us (1574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123209.126843:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 82 00010000:00010000:0.0:1789123209.732798:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789123209.821776:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:3.0:1789123209.821790:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1789123209.821797:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000040:00080000:3.0:1789123209.993507:0:12081:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789123209.993521:0:12081:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789123209.993570:0:12081:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789123209.993579:0:12081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789123209.994690:0:12081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355fcb40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12081:1876031381260160:192.168.206.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789123209.996068:0:12081:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34084fbcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123209.998966:0:12081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355fcb40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12081:1876031381260160:192.168.206.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789123210.001410:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123210.007965:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364499712 00000100:00100000:0.0:1789123210.007985:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364499712 00000100:00100000:0.0:1789123210.008060:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 233 00000100:00100000:0.0:1789123210.008072:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+26:11826:x1876031364499712:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789123210.008118:0:5841:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789123210.008495:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+26:11826:x1876031364499712:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 Request processed in 424us (7097us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123210.008516:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 233 00000100:00100000:0.0:1789123210.018912:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123210.018961:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364499968 00000100:00100000:0.0:1789123210.018972:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364499968 00000100:00100000:0.0:1789123210.019037:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 234 00000100:00100000:0.0:1789123210.019049:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343568f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+26:11826:x1876031364499968:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789123210.019074:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123210.019099:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc92ad2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f8ec expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123210.019238:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92ad9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123210.019257:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123210.019282:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123210.019296:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789123210.019458:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52600/0x7e1648d68fc92ad2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8ec expref: 29 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123210.019477:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92ad9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8ec expref: 28 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123210.019487:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:0.0:1789123210.019490:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789123210.019504:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53e00, rc 0) 00000100:00100000:0.0:1789123210.019574:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343568f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+28:11826:x1876031364499968:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 526us (676us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1789123210.019583:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 234 00000100:00100000:0.0:1789123210.028609:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123210.028735:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123210.031948:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364500224 00000100:00100000:3.0:1789123210.031971:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364500224 00000100:00100000:3.0:1789123210.032081:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 235 00000100:00100000:3.0:1789123210.032093:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+28:11826:x1876031364500224:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789123210.032199:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92ae7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123210.032221:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92ae7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123210.032236:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92ae7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123210.032478:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92ae7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123210.032488:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92ae7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123210.032496:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92ae7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123210.032503:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbae00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123210.032508:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92ae7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123210.032517:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92ae7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123210.032531:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:3.0:1789123210.032535:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789123210.032542:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92ae7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123210.032559:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92ae7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123210.032781:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+29:11826:x1876031364500224:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 688us (4187us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1789123210.032791:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 235 00000100:00100000:3.0:1789123210.032825:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364500352 00000100:00100000:3.0:1789123210.032831:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364500352 00000100:00100000:3.0:1789123210.032871:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 17 00000100:00100000:3.0:1789123210.032879:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b4b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+29:2355:x1876031364500352:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789123210.032892:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123210.032908:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53e00/0x7e1648d68fc92ad9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8ec expref: 29 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123210.032921:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:3.0:1789123210.032925:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789123210.032945:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b4b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+28:2355:x1876031364500352:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 67us (4211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123210.032953:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 17 00000040:00080000:3.0:1789123210.033218:0:12081:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789123210.033224:0:12081:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789123210.040083:0:12081:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789123210.040103:0:12081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789123210.040318:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123210.040396:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364500608 00000100:00100000:3.0:1789123210.040407:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364500608 00000100:00100000:3.0:1789123210.040501:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 64 00000100:00100000:3.0:1789123210.040514:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+28:11826:x1876031364500608:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789123210.040855:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+29:11826:x1876031364500608:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 Request processed in 343us (543us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1789123210.040864:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 64 00000040:00080000:1.0:1789123210.043559:0:12861:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789123210.043572:0:12861:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789123210.043671:0:12861:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789123210.043678:0:12861:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789123210.237822:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123210.237963:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364500864 00000100:00100000:0.0:1789123210.237977:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364500864 00000100:00100000:0.0:1789123210.238052:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 236 00000100:00100000:0.0:1789123210.238063:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+29:11839:x1876031364500864:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:0.0:1789123210.238097:0:7640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123210.238134:0:7640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc92aee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f8f3 expref: -99 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123210.238281:0:7640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53200/0x7e1648d68fc92af5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123210.238298:0:7640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53200/0x7e1648d68fc92af5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123210.238311:0:7640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53200/0x7e1648d68fc92af5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7640 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123210.238323:0:7640:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789123210.238480:0:7640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc92aee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8f3 expref: 32 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123210.238500:0:7640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53200/0x7e1648d68fc92af5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8f3 expref: 31 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123210.238521:0:7640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:0.0:1789123210.238524:0:7640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789123210.238528:0:7640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53200, rc 0) 00000100:00100000:0.0:1789123210.238610:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+31:11839:x1876031364500864:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 548us (801us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1789123210.238618:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 236 00000100:00100000:2.0:1789123210.248291:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123210.248468:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364500992 00000100:00100000:3.0:1789123210.248481:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364500992 00000100:00100000:3.0:1789123210.248556:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 237 00000100:00100000:3.0:1789123210.248568:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34048a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+31:11839:x1876031364500992:12345-192.168.206.30@tcp:54:lfs.0 00010000:00010000:3.0:1789123210.248698:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92b03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123210.248720:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92b03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123210.248734:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92b03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123210.248769:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92b03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123210.248793:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92b03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123210.248800:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92b03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123210.248807:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbae00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:3.0:1789123210.248811:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92b03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123210.248838:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92b03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123210.248853:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:3.0:1789123210.248856:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789123210.248862:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92b03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123210.248868:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc92b03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123210.248955:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34048a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+31:11839:x1876031364500992:12345-192.168.206.30@tcp:54:lfs.0 Request processed in 389us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123210.248964:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 237 00000100:00100000:3.0:1789123210.345119:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123210.345317:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364501120 00000100:00100000:1.0:1789123210.345329:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364501120 00000100:00100000:1.0:1789123210.345431:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 70 00000100:00100000:1.0:1789123210.345453:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2353:x1876031364501120:12345-192.168.206.30@tcp:101:cat.0 00010000:00010000:1.0:1789123210.345477:0:8519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123210.345504:0:8519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008190e111/0x7e1648d68fc92b0a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f8fa expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789123210.345543:0:8519:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa3da88, atime: 0x6aa3da88, ctime: 0x6aa3da88, blocks: 0xb 00010000:00010000:1.0:1789123210.345584:0:8519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=324s v=(0 0) 00010000:00010000:1.0:1789123210.345590:0:8519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123210.345601:0:8519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008190e111/0x7e1648d68fc92b0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8fa expref: 8 pid: 8519 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123210.345622:0:8519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008190e111/0x7e1648d68fc92b0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8fa expref: 8 pid: 8519 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123210.345681:0:8519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd33000, rc 0) 00000100:00100000:1.0:1789123210.345763:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+8:2353:x1876031364501120:12345-192.168.206.30@tcp:101:cat.0 Request processed in 314us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123210.345772:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 70 00000100:00080000:2.0:1789123210.345916:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789123210.351453:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123210.351949:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364501248 00000100:00100000:0.0:1789123210.351962:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364501248 00002000:00100000:0.0:1789123210.352030:0:6692:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9f343c306940 x1876031364501248/t0(0) o3->64de9449-4320-4c9f-abcb-230edd2b11ae@192.168.206.30@tcp:476/0 lens 488/0 e 0 to 0 dl 1789123221 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789123210.352043:0:6692:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9f343c306940 with x1876031364501248 ext(0->4095) 00002000:00010000:0.0:1789123210.352050:0:6692:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f343c306940 00000100:00100000:0.0:1789123210.352359:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:0.0:1789123210.352371:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c306940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+8:2355:x1876031364501248:12345-192.168.206.30@tcp:3:cat.0 00000100:00100000:0.0:1789123210.352685:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c306940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+8:2355:x1876031364501248:12345-192.168.206.30@tcp:3:cat.0 Request processed in 315us (1247us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789123210.352695:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 7 00002000:00100000:0.0:1789123210.352702:0:6692:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9f343c306940 x1876031364501248/t0(0) o3->64de9449-4320-4c9f-abcb-230edd2b11ae@192.168.206.30@tcp:476/0 lens 488/4536 e 0 to 0 dl 1789123221 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789123210.352711:0:6692:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9f343c306940 with x1876031364501248 ext(0->4095) 00002000:00010000:0.0:1789123210.352715:0:6692:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f343c306940 00010000:00010000:1.0:1789123210.757137:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789123211.268792:0:7674:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 325599162275ns, next at 326599160320ns, rc = 0 00000100:00100000:0.0:1789123211.268814:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789123211.268839:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c30da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381260288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789123211.268896:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123211.268954:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381260288 00000100:00100000:0.0:1789123211.268961:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381260288 00000100:00100000:0.0:1789123211.269012:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789123211.269022:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435671e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1876031381260288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789123211.269053:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789123211.269095:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435671e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1876031381260288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123211.269102:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1789123211.269122:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789123211.269167:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c30da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381260288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789123211.269380:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876031381260672:0@lo:400:kworker.0 00000100:00100000:1.0:1789123211.269411:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123211.269431:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789123211.269435:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876031381260544:0@lo:400:kworker.0 00000100:00100000:1.0:1789123211.269455:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123211.269478:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381260672 00000100:00100000:1.0:1789123211.269490:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381260672 00000100:00100000:1.0:1789123211.269518:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381260544 00000100:00100000:1.0:1789123211.269520:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381260544 00000100:00100000:1.0:1789123211.269534:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789123211.269540:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d328f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876031381260672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123211.269575:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d328f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876031381260672:12345-0@lo:400:kworker.0 Request processed in 35us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123211.269582:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789123211.269593:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789123211.269600:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d328b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876031381260544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123211.269649:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d328b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876031381260544:12345-0@lo:400:kworker.0 Request processed in 26us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123211.269656:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789123211.269685:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876031381260544:0@lo:400:kworker.0 00000100:00100000:1.0:1789123211.269695:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876031381260672:0@lo:400:kworker.0 00000100:00080000:0.0:1789123211.269761:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789123211.269770:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd41f4a0-f4e3-41a1-856e-0c34af912023:3303:1876031381260416:0@lo:400:kworker.0 00000100:00100000:0.0:1789123211.269802:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123211.269835:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876031381260928:0@lo:400:kworker.0 00000100:00100000:0.0:1789123211.269854:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123211.269866:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789123211.269871:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381260800:0@lo:400:kworker.0 00000100:00100000:0.0:1789123211.269893:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123211.269918:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381260800 00000100:00100000:0.0:1789123211.269921:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381260800 00000100:00100000:0.0:1789123211.269949:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789123211.269956:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381260800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123211.269987:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381260800:12345-0@lo:400:kworker.0 Request processed in 32us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123211.270003:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1789123211.270020:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789123211.270034:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1789123211.270039:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f343551a1c0, transno 4294967307 00000004:00080000:0.0:1789123211.270049:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1789123211.270063:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f342d768b40, transno 4294967310 00000100:00100000:0.0:1789123211.270068:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381260800:0@lo:400:kworker.0 00000100:00100000:1.0:1789123211.271569:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381260416 00000100:00100000:1.0:1789123211.271578:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381260416 00000100:00100000:1.0:1789123211.271721:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1789123211.271731:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3303:x1876031381260416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123211.271798:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3303:x1876031381260416:12345-0@lo:400:kworker.0 Request processed in 68us (1994us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123211.271805:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1789123211.271835:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381260928 00000100:00100000:1.0:1789123211.271839:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381260928 00000100:00100000:1.0:1789123211.271872:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789123211.271879:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876031381260928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123211.271927:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876031381260928:12345-0@lo:400:kworker.0 Request processed in 49us (2071us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123211.271932:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:0.0:1789123211.272044:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789123211.272089:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd41f4a0-f4e3-41a1-856e-0c34af912023:3303:1876031381260416:0@lo:400:kworker.0 00000100:00100000:0.0:1789123211.272103:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876031381260928:0@lo:400:kworker.0 00010000:00010000:2.0:1789123211.782529:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789123212.100867:0:12081:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789123212.100876:0:12081:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789123212.100923:0:12081:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789123212.100930:0:12081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789123212.807509:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381261056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789123212.807580:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789123212.807588:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123212.807893:0:12667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381261056 00000100:00100000:0.0:1789123212.807901:0:12667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381261056 00000100:00100000:0.0:1789123212.807955:0:12667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789123212.807965:0:12667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381261056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789123212.808000:0:12667:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789123212.808046:0:12667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381261056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123212.808054:0:12667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789123212.808080:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381261056:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789123213.828953:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789123213.850229:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000001:00080000:3.0:1789123213.850563:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1789123213.850600:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f3403356d80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1789123213.850605:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f3406631f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f3403356540 00000020:00080000:3.0:1789123213.850609:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f3406631800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f3435569000 00000020:00080000:3.0:1789123213.850673:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000100:00100000:3.0:1789123213.850745:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381261184:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789123213.850808:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1789123213.851008:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1789123213.851195:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:3.0:1789123213.851352:0:8519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381261184 00000100:00100000:3.0:1789123213.851359:0:8519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381261184 00000100:00080000:0.0:1789123213.851461:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789123213.851539:0:8519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789123213.851549:0:8519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1876031381261184:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789123213.851709:0:8519:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789123213.851712:0:8519:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789123208 -> 1789123208 00002000:00010000:3.0:1789123213.851715:0:8519:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1789123208 -> 1789123208 00002000:00010000:3.0:1789123213.851717:0:8519:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789123208 -> 1789123208 00002000:00010000:3.0:1789123213.851720:0:8519:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1789123213.851767:0:8519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1876031381261184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 220us (959us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1789123213.851774:0:8519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000004:00080000:1.0:1789123213.851841:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f34355fe940/2, rc 0, transno 4294967324 00000100:00100000:1.0:1789123213.851848:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381261184:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789123214.240830:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123214.240873:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123214.240905:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123214.240935:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123214.240960:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364501888 00000100:00100000:3.0:1789123214.240961:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123214.240969:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364501888 00000100:00080000:3.0:1789123214.241010:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789123214.241026:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364501504 00000100:00100000:2.0:1789123214.241030:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364501504 00000100:00100000:2.0:1789123214.241060:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 167 00000100:00100000:2.0:1789123214.241071:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2354:x1876031364501888:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123214.241076:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364501632 00000100:00100000:0.0:1789123214.241086:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364501632 00000100:00100000:0.0:1789123214.241121:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364501760 00000100:00100000:0.0:1789123214.241125:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364501760 00000100:00100000:0.0:1789123214.241156:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 84 00000100:00100000:0.0:1789123214.241164:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2354:x1876031364501632:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1789123214.241179:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2354:x1876031364501888:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 109us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123214.241188:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 167 00000100:00100000:0.0:1789123214.241205:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2354:x1876031364501632:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 41us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123214.241212:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 84 00000100:00100000:2.0:1789123214.241227:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 168 00000100:00100000:0.0:1789123214.241233:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 85 00000100:00100000:2.0:1789123214.241250:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+18:2354:x1876031364501504:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123214.241256:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+8:2354:x1876031364501760:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1789123214.241287:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+18:2354:x1876031364501504:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 52us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123214.241295:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+8:2354:x1876031364501760:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 53us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123214.241298:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 168 00000100:00100000:0.0:1789123214.241308:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 85 00000100:00080000:3.0:1789123214.241387:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789123214.241390:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789123214.241392:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789123214.241433:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364501376 00000100:00100000:1.0:1789123214.241437:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364501376 00000100:00100000:1.0:1789123214.241691:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 325 00000100:00100000:1.0:1789123214.241699:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+13:2354:x1876031364501376:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123214.241734:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:19924a15-1c73-4644-a9ca-864666412d45+13:2354:x1876031364501376:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 36us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123214.241740:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 325 00000001:00080000:1.0:1789123214.453646:0:12783:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:1.0:1789123214.453663:0:12783:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:1.0:1789123214.453669:0:12783:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:2.0:1789123214.853735:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123215.469419:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123215.469528:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364502016 00000100:00100000:2.0:1789123215.469536:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364502016 00000100:00100000:2.0:1789123215.469599:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 238 00000100:00100000:2.0:1789123215.469610:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+18:11500:x1876031364502016:12345-192.168.206.30@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789123215.469753:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64de9449-4320-4c9f-abcb-230edd2b11ae+18:11500:x1876031364502016:12345-192.168.206.30@tcp:60:lhsmtool_posix.0 Request processed in 145us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123215.469761:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 238 00000100:00100000:1.0:1789123215.472218:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123215.472341:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364502272 00000100:00100000:0.0:1789123215.472352:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364502272 00000100:00100000:0.0:1789123215.472413:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 65 00000100:00100000:0.0:1789123215.472424:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d3292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+18:11500:x1876031364502272:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789123215.472960:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d3292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+19:11500:x1876031364502272:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 Request processed in 536us (750us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1789123215.472968:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 65 00000100:00100000:3.0:1789123215.737507:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123215.737709:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364502400 00000100:00100000:1.0:1789123215.737723:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364502400 00000100:00100000:1.0:1789123215.737804:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 239 00000100:00100000:1.0:1789123215.737816:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:12289:x1876031364502400:12345-192.168.206.30@tcp:101:lsof.0 00010000:00010000:1.0:1789123215.737845:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123215.737876:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92b11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f901 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123215.737959:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92b18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123215.738002:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92b18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123215.738018:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92b18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123215.739665:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789123215.739678:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1789123215.739799:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92b18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123215.739843:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32400/0x7e1648d68fc92b11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f901 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123215.739865:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92b18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f901 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123215.739876:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34226c1a00) 00010000:00010000:1.0:1789123215.739879:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789123215.739884:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd33c00, rc 0) 00000100:00100000:1.0:1789123215.741467:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:949e01ae-fd37-4d7e-878c-bf5e18b249e6+6:12289:x1876031364502400:12345-192.168.206.30@tcp:101:lsof.0 Request processed in 3635us (3957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123215.741483:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 239 00010000:00010000:2.0:1789123215.878352:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123216.388868:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789123216.388906:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381261312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789123216.389051:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123216.392274:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381261312 00000100:00100000:0.0:1789123216.392288:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381261312 00000100:00100000:0.0:1789123216.392372:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789123216.392394:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343551a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381261312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789123216.392438:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789123216.392521:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343551a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381261312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (3470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123216.392528:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1789123216.392601:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789123216.393786:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343551a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd41f4a0-f4e3-41a1-856e-0c34af912023:3303:1876031381261440:0@lo:400:kworker.0 00000100:00100000:3.0:1789123216.393877:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123216.393922:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876031381261952:0@lo:400:kworker.0 00000100:00100000:3.0:1789123216.393966:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123216.394007:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1789123216.394014:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967324 00000004:00080000:3.0:1789123216.394040:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f34355fe940, transno 4294967324 00000100:00100000:3.0:1789123216.394065:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381261312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789123216.394089:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789123216.394095:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435518780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381261824:0@lo:400:kworker.0 00000100:00100000:3.0:1789123216.394146:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123216.394342:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3435519e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876031381261696:0@lo:400:kworker.0 00000100:00100000:2.0:1789123216.394377:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123216.394401:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789123216.394407:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343551b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876031381261568:0@lo:400:kworker.0 00000100:00100000:2.0:1789123216.394430:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123216.394462:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381261440 00000100:00100000:2.0:1789123216.394469:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381261440 00000100:00100000:2.0:1789123216.394519:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789123216.394536:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3303:x1876031381261440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123216.394594:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3303:x1876031381261440:12345-0@lo:400:kworker.0 Request processed in 59us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123216.394603:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789123216.394676:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381261952 00000100:00100000:2.0:1789123216.394681:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381261952 00000100:00100000:2.0:1789123216.394719:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381261696 00000100:00100000:2.0:1789123216.394722:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381261696 00000100:00100000:2.0:1789123216.394735:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381261568 00000100:00100000:2.0:1789123216.394737:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381261568 00000100:00100000:2.0:1789123216.394748:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789123216.394754:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34184c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876031381261952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123216.394789:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34184c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876031381261952:12345-0@lo:400:kworker.0 Request processed in 35us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123216.394796:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789123216.394808:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789123216.394814:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34048a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876031381261696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123216.394844:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34048a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876031381261696:12345-0@lo:400:kworker.0 Request processed in 30us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123216.394850:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789123216.394860:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789123216.394866:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34048a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876031381261568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123216.394890:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34048a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876031381261568:12345-0@lo:400:kworker.0 Request processed in 24us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123216.394896:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:2.0:1789123216.394918:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789123216.394941:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343551b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876031381261568:0@lo:400:kworker.0 00000100:00100000:2.0:1789123216.394959:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435519e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876031381261696:0@lo:400:kworker.0 00000100:00100000:2.0:1789123216.395022:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381261824 00000100:00100000:2.0:1789123216.395025:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381261824 00000100:00100000:2.0:1789123216.395059:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789123216.395066:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062cad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381261824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123216.395100:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062cad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876031381261824:12345-0@lo:400:kworker.0 Request processed in 34us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123216.395106:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1789123216.395123:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789123216.395149:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3435518780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381261824:0@lo:400:kworker.0 00000100:00100000:2.0:1789123216.395158:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343551a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd41f4a0-f4e3-41a1-856e-0c34af912023:3303:1876031381261440:0@lo:400:kworker.0 00000100:00100000:2.0:1789123216.395167:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876031381261952:0@lo:400:kworker.0 00010000:00010000:2.0:1789123216.904925:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123217.924926:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381262080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789123217.925000:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123217.925143:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381262080 00000100:00100000:1.0:1789123217.925152:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381262080 00010000:00010000:0.0:1789123217.925216:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123217.925227:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789123217.925240:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381262080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789123217.925298:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789123217.925360:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381262080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123217.925368:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789123217.925718:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381262080:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789123218.949074:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789123218.995823:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1789123218.995841:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1789123218.995907:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1789123218.995936:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:2.0:1789123219.360837:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123219.360961:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123219.361001:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123219.361024:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123219.361050:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123219.361090:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364503040 00000100:00100000:2.0:1789123219.361101:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364503040 00000100:00100000:2.0:1789123219.361171:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364502656 00000100:00100000:2.0:1789123219.361174:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364502656 00000100:00100000:2.0:1789123219.361197:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 172 00000100:00100000:2.0:1789123219.361208:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34048a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:949e01ae-fd37-4d7e-878c-bf5e18b249e6+6:2355:x1876031364503040:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1789123219.361321:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34048a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:949e01ae-fd37-4d7e-878c-bf5e18b249e6+6:2355:x1876031364503040:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 115us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123219.361330:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 172 00000100:00100000:2.0:1789123219.361349:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 173 00000100:00100000:2.0:1789123219.361355:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+18:2355:x1876031364502656:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1789123219.361385:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+18:2355:x1876031364502656:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 30us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123219.361391:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 173 00000100:00080000:2.0:1789123219.361410:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789123219.362393:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364502784 00000100:00100000:3.0:1789123219.362407:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364502784 00000100:00100000:3.0:1789123219.362455:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364502912 00000100:00100000:3.0:1789123219.362457:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364502912 00000100:00100000:3.0:1789123219.362480:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 87 00000100:00100000:3.0:1789123219.362488:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34048a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2355:x1876031364502784:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1789123219.362555:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34048a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2355:x1876031364502784:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 67us (1594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123219.362575:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 87 00000100:00100000:3.0:1789123219.362590:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 88 00000100:00100000:3.0:1789123219.362596:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343551a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2355:x1876031364502912:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1789123219.362622:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343551a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2355:x1876031364502912:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 27us (1572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123219.362647:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 88 00000100:00080000:2.0:1789123219.363852:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789123219.363861:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789123219.365345:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364502528 00000100:00100000:1.0:1789123219.365360:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364502528 00000100:00100000:1.0:1789123219.365434:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 327 00000100:00100000:1.0:1789123219.365449:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+13:2355:x1876031364502528:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123219.365555:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+13:2355:x1876031364502528:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 110us (4733us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123219.365563:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 327 00000001:02000400:1.0:1789123219.967400:0:13062:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 06:40:18 (1789123218) 00010000:00010000:0.0:1789123219.973346:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123220.996863:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123221.509958:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381262208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789123221.510030:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123221.510109:0:12667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381262208 00000100:00100000:0.0:1789123221.510129:0:12667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381262208 00000100:00100000:0.0:1789123221.510185:0:12667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789123221.510196:0:12667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381262208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789123221.510240:0:12667:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789123221.510300:0:12667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381262208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123221.510308:0:12667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789123221.510358:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381262208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789123221.510608:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381262592:0@lo:400:kworker.0 00000100:00100000:1.0:1789123221.510675:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123221.510698:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789123221.510704:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381262720:0@lo:400:kworker.0 00000100:00100000:1.0:1789123221.510746:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123221.510780:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381262720 00000100:00100000:1.0:1789123221.510784:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381262720 00000100:00100000:1.0:1789123221.510819:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789123221.510826:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f33035aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381262720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123221.510863:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f33035aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381262720:12345-0@lo:400:kworker.0 Request processed in 37us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123221.510870:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789123221.510898:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381262720:0@lo:400:kworker.0 00000100:00080000:2.0:1789123221.511035:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789123221.511039:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789123221.511047:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876031381262464:0@lo:400:kworker.0 00000100:00100000:2.0:1789123221.511073:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123221.511090:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789123221.511094:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd41f4a0-f4e3-41a1-856e-0c34af912023:3303:1876031381262336:0@lo:400:kworker.0 00000100:00100000:2.0:1789123221.511126:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123221.511149:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876031381262848:0@lo:400:kworker.0 00000100:00100000:2.0:1789123221.511169:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123221.511191:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381262592 00000100:00100000:2.0:1789123221.511194:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381262592 00000100:00100000:2.0:1789123221.511238:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381262464 00000100:00100000:2.0:1789123221.511242:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381262464 00000100:00100000:2.0:1789123221.511263:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381262848 00000100:00100000:2.0:1789123221.511266:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381262848 00000100:00100000:1.0:1789123221.511407:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789123221.511418:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343fc07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381262592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123221.511460:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343fc07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381262592:12345-0@lo:400:kworker.0 Request processed in 45us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123221.511469:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789123221.511489:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789123221.511499:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435519e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876031381262464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123221.511533:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435519e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876031381262464:12345-0@lo:400:kworker.0 Request processed in 38us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123221.511539:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789123221.511564:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876031381262464:0@lo:400:kworker.0 00000100:00100000:1.0:1789123221.511590:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381262592:0@lo:400:kworker.0 00000100:00100000:2.0:1789123221.511686:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789123221.511692:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343551b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876031381262848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123221.511727:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343551b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876031381262848:12345-0@lo:400:kworker.0 Request processed in 35us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123221.511733:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789123221.511749:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381262336 00000100:00100000:2.0:1789123221.511753:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381262336 00000100:00100000:2.0:1789123221.511777:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789123221.511783:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3303:x1876031381262336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123221.511812:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3303:x1876031381262336:12345-0@lo:400:kworker.0 Request processed in 29us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123221.511818:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00080000:2.0:1789123221.511842:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789123221.511862:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd41f4a0-f4e3-41a1-856e-0c34af912023:3303:1876031381262336:0@lo:400:kworker.0 00000100:00100000:2.0:1789123221.511872:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876031381262848:0@lo:400:kworker.0 00010000:00010000:0.0:1789123222.020810:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789123222.342560:0:12081:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789123222.342573:0:12081:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789123222.343397:0:12081:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1789123222.343408:0:12081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789123223.046536:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789123223.046569:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34354f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381262976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789123223.046684:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123223.046850:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381262976 00010000:00010000:3.0:1789123223.046852:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123223.046862:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381262976 00000100:00100000:0.0:1789123223.046942:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789123223.046952:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f33035a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381262976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789123223.047005:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789123223.047203:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789123223.047569:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f33035a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381262976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 615us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123223.047578:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789123223.047705:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34354f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381262976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789123223.975932:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123223.976880:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364503296 00000100:00100000:0.0:1789123223.976896:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364503296 00000100:00100000:0.0:1789123223.976997:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 66 00000100:00100000:0.0:1789123223.977011:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+18:12512:x1876031364503296:12345-192.168.206.30@tcp:35:umount.0 00000100:00100000:0.0:1789123223.978239:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+19:12512:x1876031364503296:12345-192.168.206.30@tcp:35:umount.0 Request processed in 1222us (2310us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1789123223.978251:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 66 00000100:00080000:2.0:1789123223.978481:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789123223.988817:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123223.988955:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364503552 00000100:00100000:3.0:1789123223.988968:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364503552 00000100:00100000:3.0:1789123223.989029:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 67 00000100:00100000:3.0:1789123223.989039:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34354f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+19:12512:x1876031364503552:12345-192.168.206.30@tcp:35:umount.0 00000100:00100000:3.0:1789123223.990175:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34354f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+20:12512:x1876031364503552:12345-192.168.206.30@tcp:35:umount.0 Request processed in 1128us (1362us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1789123223.990196:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 67 00000100:00100000:2.0:1789123224.001019:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123224.001222:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364503808 00000100:00100000:0.0:1789123224.001236:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364503808 00000100:00100000:0.0:1789123224.001323:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 68 00000100:00100000:0.0:1789123224.001350:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427ab9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+20:12512:x1876031364503808:12345-192.168.206.30@tcp:35:umount.0 00000100:00100000:0.0:1789123224.003348:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427ab9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64de9449-4320-4c9f-abcb-230edd2b11ae+21:12512:x1876031364503808:12345-192.168.206.30@tcp:35:umount.0 Request processed in 1990us (2320us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1789123224.003363:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 68 00000100:00100000:2.0:1789123224.013453:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123224.014659:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364504064 00000100:00100000:3.0:1789123224.014675:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364504064 00000100:00100000:3.0:1789123224.014760:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 69 00000100:00100000:3.0:1789123224.014772:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3435518780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+21:12512:x1876031364504064:12345-192.168.206.30@tcp:35:umount.0 00000100:00100000:3.0:1789123224.022889:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3435518780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+22:12512:x1876031364504064:12345-192.168.206.30@tcp:35:umount.0 Request processed in 8104us (9435us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789123224.022907:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 69 00000100:00100000:2.0:1789123224.027182:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123224.027240:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123224.027318:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364504192 00000100:00100000:0.0:1789123224.027331:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364504192 00000100:00100000:0.0:1789123224.027417:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364504320 00000100:00100000:0.0:1789123224.027420:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364504320 00000100:00100000:0.0:1789123224.027447:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 18 00000100:00100000:0.0:1789123224.027458:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d768b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19924a15-1c73-4644-a9ca-864666412d45+14:2354:x1876031364504192:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789123224.027477:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123224.027512:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3401515a00/0x7e1648d68fc91b51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f47e expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123224.027534:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123224.027599:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d768b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19924a15-1c73-4644-a9ca-864666412d45+13:2354:x1876031364504192:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 143us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123224.027608:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 18 00000100:00100000:0.0:1789123224.027655:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 19 00000100:00100000:0.0:1789123224.027678:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063c8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19924a15-1c73-4644-a9ca-864666412d45+12:2354:x1876031364504320:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789123224.027700:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123224.027711:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f342d80a000/0x7e1648d68fc91ab7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f446 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123224.027721:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123224.027741:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063c8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19924a15-1c73-4644-a9ca-864666412d45+11:2354:x1876031364504320:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 64us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123224.027747:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 19 00000100:00100000:2.0:1789123224.035549:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123224.035681:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364504704 00000100:00100000:0.0:1789123224.035703:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364504704 00000100:00100000:0.0:1789123224.035791:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 72 00000100:00100000:0.0:1789123224.035805:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d76a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+7:2351:x1876031364504704:12345-192.168.206.30@tcp:9:umount.0 00000020:00000080:0.0:1789123224.035850:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc920d0 00000020:00010000:0.0:1789123224.035859:0:6687:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9f343fca1000: total 0 00000100:00080000:0.0:1789123224.035865:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9f343fca7800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789123224.035928:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1789123224.036326:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d76a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2351:x1876031364504704:12345-192.168.206.30@tcp:9:umount.0 Request processed in 523us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123224.036337:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 72 00000020:00010000:0.0:1789123224.036369:0:5828:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9f343fca1000: total 0 00010000:00010000:0.0:1789123224.036393:0:5828:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f343fca1000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1789123224.036465:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008190e111/0x7e1648d68fc92b0a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8fa expref: 4 pid: 8519 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123224.036504:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009128a704/0x7e1648d68fc9246c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f72c expref: 3 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123224.036539:0:5828:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f343fca1000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1789123224.036552:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123224.036554:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123224.036556:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789123224.036841:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789123224.051978:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123224.052094:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364504832 00000100:00100000:3.0:1789123224.052107:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364504832 00000100:00100000:3.0:1789123224.052205:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 20 00000100:00100000:3.0:1789123224.052216:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d768b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19924a15-1c73-4644-a9ca-864666412d45+11:2354:x1876031364504832:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789123224.052239:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123224.052267:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f342d80b800/0x7e1648d68fc91da4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f557 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123224.052290:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789123224.052368:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d768b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19924a15-1c73-4644-a9ca-864666412d45+10:2354:x1876031364504832:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 154us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123224.052377:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 20 00000100:00100000:2.0:1789123224.058614:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123224.058822:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364504960 00000100:00100000:1.0:1789123224.058834:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364504960 00000100:00100000:1.0:1789123224.058926:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 73 00000100:00100000:1.0:1789123224.058938:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407d3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+5:2351:x1876031364504960:12345-192.168.206.30@tcp:9:umount.0 00000020:00000080:1.0:1789123224.058977:0:6688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc91e68 00000100:00080000:1.0:1789123224.058988:0:6688:0:(import.c:65:import_set_state_nolock()) ffff9f343bd2b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789123224.059038:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1789123224.059395:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407d3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64de9449-4320-4c9f-abcb-230edd2b11ae+2:2351:x1876031364504960:12345-192.168.206.30@tcp:9:umount.0 Request processed in 460us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123224.059416:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 73 00010000:00010000:0.0:1789123224.059710:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789123224.059775:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789123224.068876:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123224.076898:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123224.077013:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364505984 00000100:00100000:3.0:1789123224.077026:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364505984 00000100:00100000:3.0:1789123224.077109:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 240 00000100:00100000:3.0:1789123224.077120:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f33035a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+22:2351:x1876031364505984:12345-192.168.206.30@tcp:39:umount.0 00000020:00000080:3.0:1789123224.077167:0:5841:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc91ac5 00000020:00010000:3.0:1789123224.077198:0:5841:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9f343592b800: total 0 00000100:00080000:3.0:1789123224.077205:0:5841:0:(import.c:65:import_set_state_nolock()) ffff9f343bd29800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789123224.077235:0:5841:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:3.0:1789123224.077805:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f33035a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64de9449-4320-4c9f-abcb-230edd2b11ae+21:2351:x1876031364505984:12345-192.168.206.30@tcp:39:umount.0 Request processed in 682us (916us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1789123224.077816:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 240 00000020:00010000:3.0:1789123224.077844:0:5827:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9f343592b800: total 0 00010000:00010000:3.0:1789123224.077849:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123224.077899:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f343592b800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1789123224.077938:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34226c1a00) 00010000:00010000:3.0:1789123224.077955:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789123224.077964:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc924ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f748 expref: 20 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123224.077987:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f3411751e00) 00010000:00010000:3.0:1789123224.077990:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789123224.077993:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514000/0x7e1648d68fc91dea lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f56c expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123224.078011:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:3.0:1789123224.078013:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789123224.078017:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52200/0x7e1648d68fc92457 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f725 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123224.078029:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:3.0:1789123224.078031:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789123224.078034:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbac00/0x7e1648d68fc92acb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8e5 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123224.078044:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:3.0:1789123224.078047:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789123224.078050:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53200/0x7e1648d68fc92af5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8f3 expref: 16 pid: 7640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123224.078805:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:3.0:1789123224.078813:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789123224.078822:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80aa00/0x7e1648d68fc9242d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f717 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123224.078859:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:3.0:1789123224.078862:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789123224.078866:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b400/0x7e1648d68fc927c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f821 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123224.078878:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:3.0:1789123224.078880:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789123224.078884:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc9212b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f653 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123224.078896:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f34232f7a00) 00010000:00010000:3.0:1789123224.078898:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789123224.078902:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80be00/0x7e1648d68fc91dce lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f565 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123224.078921:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f3411751300) 00010000:00010000:3.0:1789123224.078923:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789123224.078927:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbaa00/0x7e1648d68fc924ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f74f expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123224.078941:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f3411751400) 00010000:00010000:3.0:1789123224.078943:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789123224.078947:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd32600/0x7e1648d68fc9234d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f6df expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123224.081425:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f340534db00) 00010000:00010000:3.0:1789123224.081437:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789123224.081471:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33600/0x7e1648d68fc91e3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f581 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123224.081740:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f34232f7800) 00010000:00010000:3.0:1789123224.081744:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789123224.081749:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52000/0x7e1648d68fc929eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f8ad expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123224.081769:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f343592b800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1789123224.081826:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123224.081828:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123224.081831:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789123224.158525:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00080000:1.0:1789123224.159010:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000100:00100000:2.0:1789123224.475364:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123224.475455:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123224.475584:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364506240 00000100:00100000:1.0:1789123224.475584:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364506112 00000100:00100000:3.0:1789123224.475596:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364506240 00000100:00100000:1.0:1789123224.475596:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364506112 00000100:00100000:1.0:1789123224.475686:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 329 00000100:00100000:3.0:1789123224.475687:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 177 00000100:00100000:3.0:1789123224.475698:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:949e01ae-fd37-4d7e-878c-bf5e18b249e6+6:2352:x1876031364506240:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123224.475698:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+10:2352:x1876031364506112:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1789123224.475788:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:949e01ae-fd37-4d7e-878c-bf5e18b249e6+6:2352:x1876031364506240:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 91us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123224.475796:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 177 00000100:00080000:2.0:1789123224.475934:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789123224.476963:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+10:2352:x1876031364506112:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 1257us (1605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123224.476975:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 329 00000001:00100000:2.0:1789123224.651418:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 64de9449-4320-4c9f-abcb-230edd2b11ae 00000020:00000080:2.0:1789123224.651431:0:7644:0:(genops.c:885:class_export_put()) final put ffff9f343fca1000/64de9449-4320-4c9f-abcb-230edd2b11ae 00000020:00000080:1.0:1789123224.651507:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f343fca1000/64de9449-4320-4c9f-abcb-230edd2b11ae for lustre-OST0001 00000020:00000080:1.0:1789123224.651574:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f343fca7800 for lustre-OST0001 00010000:00010000:0.0:1789123225.096291:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789123225.188690:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 64de9449-4320-4c9f-abcb-230edd2b11ae 00000020:00000080:3.0:1789123225.188700:0:6710:0:(genops.c:885:class_export_put()) final put ffff9f343bd28000/64de9449-4320-4c9f-abcb-230edd2b11ae 00000020:00000080:2.0:1789123225.188824:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f343bd28000/64de9449-4320-4c9f-abcb-230edd2b11ae for lustre-OST0000 00000020:00000080:2.0:1789123225.188878:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f343bd2b000 for lustre-OST0000 00010000:00010000:3.0:1789123226.117555:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123226.628862:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34354f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381263104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789123226.628934:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123226.628992:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789123226.628998:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062c9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381263232:0@lo:400:kworker.0 00000100:00100000:1.0:1789123226.629029:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123226.629055:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381263616:0@lo:400:kworker.0 00000100:00100000:3.0:1789123226.629073:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381263104 00000100:00100000:1.0:1789123226.629079:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123226.629080:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381263104 00000100:00100000:1.0:1789123226.629097:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789123226.629104:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876031381263744:0@lo:400:kworker.0 00000100:00100000:1.0:1789123226.629131:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123226.629149:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876031381263488:0@lo:400:kworker.0 00000100:00100000:3.0:1789123226.629153:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789123226.629163:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f33035a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381263104:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789123226.629167:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381263616 00000100:00100000:1.0:1789123226.629183:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381263616 00000100:00100000:2.0:1789123226.629197:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1789123226.629207:0:6689:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123226.629222:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789123226.629228:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876031381263360:0@lo:400:kworker.0 00000100:00100000:1.0:1789123226.629237:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789123226.629246:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f33035a83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381263616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123226.629262:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f33035a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381263104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123226.629270:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123226.629277:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789123226.629292:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f33035a83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381263616:12345-0@lo:400:kworker.0 Request processed in 47us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123226.629300:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789123226.629305:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381263232 00000100:00080000:3.0:1789123226.629309:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789123226.629310:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381263232 00000100:00080000:3.0:1789123226.629313:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789123226.629333:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381263744 00000100:00100000:1.0:1789123226.629337:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381263744 00000100:00100000:2.0:1789123226.629342:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789123226.629351:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3304:x1876031381263232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123226.629387:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3304:x1876031381263232:12345-0@lo:400:kworker.0 Request processed in 36us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123226.629395:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1789123226.629411:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381263488 00000100:00100000:0.0:1789123226.629415:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381263488 00000100:00100000:3.0:1789123226.631151:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381263616:0@lo:400:kworker.0 00000100:00100000:3.0:1789123226.631165:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062c9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381263232:0@lo:400:kworker.0 00000100:00100000:1.0:1789123226.631347:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381263360 00000100:00100000:1.0:1789123226.631353:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381263360 00000100:00100000:0.0:1789123226.631397:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789123226.631406:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f33035a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876031381263744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123226.631461:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f33035a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876031381263744:12345-0@lo:400:kworker.0 Request processed in 57us (2330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123226.631468:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789123226.631480:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789123226.631486:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f340665da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876031381263488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123226.631515:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f340665da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876031381263488:12345-0@lo:400:kworker.0 Request processed in 29us (2319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123226.631521:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789123226.631551:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876031381263488:0@lo:400:kworker.0 00000100:00080000:0.0:1789123226.634518:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789123226.634646:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789123226.634664:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876031381263360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123226.634745:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876031381263360:12345-0@lo:400:kworker.0 Request processed in 91us (5475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123226.634753:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789123226.634789:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876031381263360:0@lo:400:kworker.0 00000100:00100000:3.0:1789123226.638807:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34354f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381263104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789123226.638883:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876031381263744:0@lo:400:kworker.0 00000100:00100000:1.0:1789123226.876402:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123226.876461:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123226.876513:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123226.876616:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364506496 00000100:00100000:0.0:1789123226.876668:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364506496 00000100:00100000:0.0:1789123226.876751:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364506368 00000100:00100000:0.0:1789123226.876754:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364506368 00000100:00100000:2.0:1789123226.876766:0:11614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364506624 00000100:00100000:2.0:1789123226.876777:0:11614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364506624 00000100:00100000:0.0:1789123226.876785:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 21 00000100:00100000:0.0:1789123226.876818:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f33035a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19924a15-1c73-4644-a9ca-864666412d45+12:2354:x1876031364506496:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789123226.876837:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789123226.876846:0:11614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 22 00000100:00100000:2.0:1789123226.876860:0:11614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f33035aa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19924a15-1c73-4644-a9ca-864666412d45+12:2354:x1876031364506368:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789123226.876865:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f343bd32000/0x7e1648d68fc91b9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f4bd expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123226.876888:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789123226.876892:0:11614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123226.876918:0:11614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f34029f2000/0x7e1648d68fc91b97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f493 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123226.876939:0:11614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123226.876962:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f33035a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19924a15-1c73-4644-a9ca-864666412d45+10:2354:x1876031364506496:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 146us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123226.876972:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 21 00000100:00100000:0.0:1789123226.877000:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 23 00000100:00100000:0.0:1789123226.877010:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f33035ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19924a15-1c73-4644-a9ca-864666412d45+9:2354:x1876031364506624:12345-192.168.206.30@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789123226.877018:0:11614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f33035aa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:19924a15-1c73-4644-a9ca-864666412d45+9:2354:x1876031364506368:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 159us (554us total) trans 0 rc 0/0 00010000:00010000:0.0:1789123226.877021:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789123226.877037:0:11614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 22 00010000:00010000:0.0:1789123226.877058:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f34029f2a00/0x7e1648d68fc91d9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f550 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123226.877079:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123226.877107:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f33035ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:19924a15-1c73-4644-a9ca-864666412d45+7:2354:x1876031364506624:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 98us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123226.877114:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 23 00000100:00100000:3.0:1789123226.887352:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123226.887442:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364506880 00000100:00100000:0.0:1789123226.887456:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364506880 00000100:00080000:3.0:1789123226.887604:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789123226.887697:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 241 00000100:00100000:0.0:1789123226.887708:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:949e01ae-fd37-4d7e-878c-bf5e18b249e6+6:2351:x1876031364506880:12345-192.168.206.30@tcp:39:umount.0 00000020:00000080:0.0:1789123226.887743:0:5840:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc91bac 00000020:00010000:0.0:1789123226.887749:0:5840:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9f33012b3800: total 0 00000100:00080000:0.0:1789123226.887754:0:5840:0:(import.c:65:import_set_state_nolock()) ffff9f33012b0000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789123226.887780:0:5840:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:2.0:1789123226.887818:0:5828:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9f33012b3800: total 0 00010000:00010000:2.0:1789123226.887916:0:5828:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f33012b3800, canceled 0 locks, left on hash table 1. 00000100:00100000:0.0:1789123226.888037:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:949e01ae-fd37-4d7e-878c-bf5e18b249e6+5:2351:x1876031364506880:12345-192.168.206.30@tcp:39:umount.0 Request processed in 329us (698us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789123226.888055:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 241 00010000:00010000:2.0:1789123226.888693:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f34226c1a00) 00010000:00010000:2.0:1789123226.888700:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789123226.888715:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f343bd33c00/0x7e1648d68fc92b18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f901 expref: 4 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123226.888754:0:5828:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f33012b3800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789123226.888787:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123226.888790:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123226.888792:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123226.919346:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123226.919433:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364507136 00000100:00100000:1.0:1789123226.919442:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364507136 00000100:00100000:1.0:1789123226.919492:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 331 00000100:00100000:1.0:1789123226.919502:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3407b5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+7:2351:x1876031364507136:12345-192.168.206.30@tcp:251:umount.0 00000020:00000080:1.0:1789123226.919542:0:5835:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc91aa2 00000020:00010000:1.0:1789123226.919550:0:5835:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9f343592c800: total 0 00000100:00080000:1.0:1789123226.919555:0:5835:0:(import.c:65:import_set_state_nolock()) ffff9f3435929800 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1789123226.919734:0:5827:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9f343592c800: total 0 00010000:00010000:3.0:1789123226.919738:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123226.919781:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f343592c800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789123226.919812:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3401515000/0x7e1648d68fc91b58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f485 expref: 3 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123226.919829:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f343592c800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1789123226.919837:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123226.919839:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123226.919841:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123226.919885:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3407b5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:19924a15-1c73-4644-a9ca-864666412d45+3:2351:x1876031364507136:12345-192.168.206.30@tcp:251:umount.0 Request processed in 126us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123226.919912:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 331 00000020:00000080:1.0:1789123226.919921:0:5835:0:(genops.c:885:class_export_put()) final put ffff9f343592c800/19924a15-1c73-4644-a9ca-864666412d45 00000020:00000080:3.0:1789123226.920012:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f343592c800/19924a15-1c73-4644-a9ca-864666412d45 for MGS 00000020:00000080:3.0:1789123226.920051:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f3435929800 for MGS 00010000:00010000:2.0:1789123227.141624:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123228.164801:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123228.165813:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34354f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381263872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789123228.165890:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123228.165991:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381263872 00000100:00100000:0.0:1789123228.165999:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381263872 00000100:00100000:0.0:1789123228.166057:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789123228.166066:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381263872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789123228.166099:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789123228.166144:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381263872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123228.166150:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1789123228.166269:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789123228.166305:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34354f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381263872:0@lo:13:osp-pre-0-0.0 00000020:01000004:0.0:1789123228.963467:0:13263:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1789123228.984800:0:13263:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1789123228.984847:0:13263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401515e00/0x7e1648d68fc91b27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b2e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123228.984861:0:13263:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401515e00/0x7e1648d68fc91b27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91b2e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123228.984868:0:13263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401515e00/0x7e1648d68fc91b27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e1648d68fc91b2e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123228.984876:0:13263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9f3401515e00/0x7e1648d68fc91b27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e1648d68fc91b2e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123228.984900:0:13263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789123228.984906:0:13263:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789123228.984930:0:13263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789123228.984934:0:13263:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789123228.984947:0:13263:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1789123228.984952:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789123228.984961:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f3401515e00/0x7e1648d68fc91b27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e1648d68fc91b2e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789123228.984970:0:13263:0:(import.c:65:import_set_state_nolock()) ffff9f343bd1a800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1789123228.984971:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401515e00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1789123228.984976:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f3401515e00/0x7e1648d68fc91b27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e1648d68fc91b2e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123228.984986:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f3401515e00/0x7e1648d68fc91b27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e1648d68fc91b2e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789123228.984994:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f3401515e00/0x7e1648d68fc91b27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e1648d68fc91b2e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123228.985012:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789123228.985015:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789123228.985017:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789123228.985042:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f3401515e00/0x7e1648d68fc91b27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7e1648d68fc91b2e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123228.985047:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789123228.985071:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f3401515e00/0x7e1648d68fc91b27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7e1648d68fc91b2e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123228.985077:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f3401515e00/0x7e1648d68fc91b27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7e1648d68fc91b2e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123228.985090:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123228.985091:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123228.985093:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123228.985110:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343585c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd41f4a0-f4e3-41a1-856e-0c34af912023:3303:1876031381264128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789123228.985184:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123228.985254:0:11614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381264128 00000100:00100000:2.0:1789123228.985262:0:11614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381264128 00000100:00100000:3.0:1789123228.985525:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34354f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876031381264000:0@lo:39:umount.0 00000100:00100000:3.0:1789123228.985561:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123228.985758:0:11614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789123228.985768:0:11614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3303:x1876031381264128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789123228.985782:0:11614:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123228.985798:0:11614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3400030200/0x7e1648d68fc91b2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7e1648d68fc91b27 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123228.985913:0:11614:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123228.985960:0:11614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:3303:x1876031381264128:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123228.985979:0:11614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789123228.986026:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343585c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd41f4a0-f4e3-41a1-856e-0c34af912023:3303:1876031381264128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789123228.993695:0:7640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381264000 00000100:00100000:0.0:1789123228.993706:0:7640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381264000 00000100:00100000:0.0:1789123228.993764:0:7640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789123228.993773:0:7640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876031381264000:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789123228.993799:0:7640:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc918b1 00000100:00080000:0.0:1789123228.993808:0:7640:0:(import.c:65:import_set_state_nolock()) ffff9f343b9ab000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789123228.993942:0:7640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3301:x1876031381264000:12345-0@lo:39:umount.0 Request processed in 170us (8380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123228.993950:0:7640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1789123228.993970:0:7640:0:(genops.c:885:class_export_put()) final put ffff9f343b9ac800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789123228.993994:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f343b9ac800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789123228.994039:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f343b9ab000 for lustre-MDT0000 00010000:00010000:2.0:1789123228.994255:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789123228.994537:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9f343bd1a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789123228.994555:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34354f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876031381264000:0@lo:39:umount.0 00000100:00080000:0.0:1789123228.994670:0:13263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789123228.994675:0:13263:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789123228.994680:0:13263:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789123228.996292:0:13263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3400030c00/0x7e1648d68fc91b35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b3c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123228.996311:0:13263:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3400030c00/0x7e1648d68fc91b35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91b3c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123228.996319:0:13263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3400030c00/0x7e1648d68fc91b35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e1648d68fc91b3c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123228.996326:0:13263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9f3400030c00/0x7e1648d68fc91b35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e1648d68fc91b3c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123228.996385:0:13263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789123228.996392:0:13263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34421d9a00/0x7e1648d68fc91a5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91a63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123228.996399:0:13263:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34421d9a00/0x7e1648d68fc91a5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91a63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123228.996404:0:13263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34421d9a00/0x7e1648d68fc91a5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e1648d68fc91a63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123228.996410:0:13263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9f34421d9a00/0x7e1648d68fc91a5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e1648d68fc91a63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123228.996427:0:13263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789123228.996434:0:13263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34029f3a00/0x7e1648d68fc91d8f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91d96 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123228.996441:0:13263:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34029f3a00/0x7e1648d68fc91d8f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91d96 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123228.996447:0:13263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34029f3a00/0x7e1648d68fc91d8f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e1648d68fc91d96 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123228.996453:0:13263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9f34029f3a00/0x7e1648d68fc91d8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e1648d68fc91d96 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123228.996460:0:13263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789123228.996465:0:13263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401514800/0x7e1648d68fc91810 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91817 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123228.996492:0:13263:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401514800/0x7e1648d68fc91810 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91817 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123228.996498:0:13263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401514800/0x7e1648d68fc91810 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e1648d68fc91817 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123228.996504:0:13263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9f3401514800/0x7e1648d68fc91810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e1648d68fc91817 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123228.996512:0:13263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1789123228.996515:0:13263:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1789123228.996539:0:13263:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1789123228.996544:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:2.0:1789123228.996546:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000020:00000080:0.0:1789123228.996549:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:2.0:1789123228.996553:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f3400030c00/0x7e1648d68fc91b35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e1648d68fc91b3c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123228.996561:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3400030c00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1789123228.996565:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f3400030c00/0x7e1648d68fc91b35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e1648d68fc91b3c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789123228.996566:0:13263:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00010000:00010000:2.0:1789123228.996573:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f3400030c00/0x7e1648d68fc91b35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e1648d68fc91b3c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789123228.996573:0:13263:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9f33012b1000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789123228.996579:0:13263:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9f33012b4800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:00010000:2.0:1789123228.996581:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f3400030c00/0x7e1648d68fc91b35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e1648d68fc91b3c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123228.996584:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000020:00080000:0.0:1789123228.996586:0:13263:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9f33012b3800 949e01ae-fd37-4d7e-878c-bf5e18b249e6 192.168.206.30@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 10000000:01000000:2.0:1789123228.996587:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789123228.996591:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1789123228.996593:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:00080000:0.0:1789123228.996593:0:13263:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9f343592b800 64de9449-4320-4c9f-abcb-230edd2b11ae 192.168.206.30@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 4294967524 stale:0 00000020:00080000:0.0:1789123228.996598:0:13263:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9f3407c51a48) has exports, disconnecting them 00000020:00080000:0.0:1789123228.996602:0:13263:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f33012b1000), last request at 1789123226 00000020:00000080:0.0:1789123228.996609:0:13263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc91a24 00000100:00080000:0.0:1789123228.996649:0:13263:0:(import.c:65:import_set_state_nolock()) ffff9f343b9ae000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789123228.996657:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f3400030c00/0x7e1648d68fc91b35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7e1648d68fc91b3c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123228.996663:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789123228.996683:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f3400030c00/0x7e1648d68fc91b35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7e1648d68fc91b3c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123228.996690:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f3400030c00/0x7e1648d68fc91b35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7e1648d68fc91b3c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789123228.996694:0:13263:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f33012b1000): rc 0 00000020:00000080:0.0:1789123228.996697:0:13263:0:(genops.c:885:class_export_put()) final put ffff9f33012b1000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1789123228.996707:0:13263:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f33012b4800), last request at 1789123226 00010000:00010000:2.0:1789123228.996715:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00000080:0.0:1789123228.996716:0:13263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc91959 00010000:00010000:2.0:1789123228.996718:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f34029f3a00/0x7e1648d68fc91d8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e1648d68fc91d96 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789123228.996721:0:13263:0:(import.c:65:import_set_state_nolock()) ffff9f33012b4000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789123228.996724:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34029f3a00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1789123228.996727:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f34029f3a00/0x7e1648d68fc91d8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e1648d68fc91d96 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789123228.996729:0:13263:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f33012b4800): rc 0 00000020:00000080:0.0:1789123228.996731:0:13263:0:(genops.c:885:class_export_put()) final put ffff9f33012b4800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:2.0:1789123228.996735:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f34029f3a00/0x7e1648d68fc91d8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e1648d68fc91d96 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:0.0:1789123228.996739:0:13263:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffba00c1af7ae0 10000000:00010000:2.0:1789123228.996741:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f34029f3a00/0x7e1648d68fc91d8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e1648d68fc91d96 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123228.996746:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789123228.996748:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789123228.996751:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00080000:0.0:1789123228.996757:0:13263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789123228.996761:0:13263:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00010000:00010000:2.0:1789123228.996765:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f34029f3a00/0x7e1648d68fc91d8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7e1648d68fc91d96 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123228.996768:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343585c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381264256:0@lo:103:ldlm_bl.0 00000004:00080000:0.0:1789123228.996773:0:13263:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:2.0:1789123228.996775:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789123228.996783:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f34029f3a00/0x7e1648d68fc91d8f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7e1648d68fc91d96 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123228.996790:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f34029f3a00/0x7e1648d68fc91d8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7e1648d68fc91d96 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123228.996800:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789123228.996803:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f3401514800/0x7e1648d68fc91810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e1648d68fc91817 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123228.996827:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401514800 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1789123228.996831:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f3401514800/0x7e1648d68fc91810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e1648d68fc91817 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123228.996841:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789123228.996842:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f3401514800/0x7e1648d68fc91810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e1648d68fc91817 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789123228.996851:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f3401514800/0x7e1648d68fc91810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e1648d68fc91817 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123228.996855:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789123228.996858:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789123228.996860:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:3.0:1789123228.996891:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789123228.996898:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343585f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381264384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789123228.996924:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123228.996952:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381264256 00000100:00100000:3.0:1789123228.996958:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381264256 00000100:00080000:0.0:1789123228.997817:0:13263:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789123228.997904:0:13263:0:(import.c:65:import_set_state_nolock()) ffff9f34067c2800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789123228.997922:0:13263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789123228.997925:0:13263:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1789123228.997938:0:13263:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789123228.998003:0:13263:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789123228.998014:0:13263:0:(import.c:65:import_set_state_nolock()) ffff9f3406276800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789123228.998045:0:13263:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9f3407c51a48) has no exports 00010000:00010000:2.0:1789123228.998788:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f3401514800/0x7e1648d68fc91810 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7e1648d68fc91817 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123228.998800:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789123228.998832:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381264384 00000100:00100000:3.0:1789123228.998840:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381264384 00000100:00100000:3.0:1789123228.998868:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1789123228.998875:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f3401514800/0x7e1648d68fc91810 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7e1648d68fc91817 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123228.998877:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd41f4a0-f4e3-41a1-856e-0c34af912023+19:3304:x1876031381264256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789123228.998890:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f3401514800/0x7e1648d68fc91810 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7e1648d68fc91817 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123228.998895:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123228.998910:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123228.998914:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123228.998916:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f343bd33e00/0x7e1648d68fc91b3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7e1648d68fc91b35 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123228.998917:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123228.998931:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123228.998933:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343585ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381264768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789123228.999076:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789123228.999092:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34063c9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+18:3304:x1876031381264384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789123228.999101:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123228.999110:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f34029f2200/0x7e1648d68fc91d96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7e1648d68fc91d8f expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123228.999122:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789123228.999225:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:3304:x1876031381264256:12345-0@lo:103:ldlm_bl.0 Request processed in 348us (2384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123228.999232:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789123228.999375:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123228.999430:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381264768 00000100:00100000:2.0:1789123228.999449:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381264768 00000100:00100000:2.0:1789123228.999646:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789123228.999657:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c309a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+17:3302:x1876031381264768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789123228.999666:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123228.999676:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3400031600/0x7e1648d68fc91817 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7e1648d68fc91810 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123228.999692:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123228.999726:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c309a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:3302:x1876031381264768:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123228.999732:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789123228.999768:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343585ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381264768:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789123229.000407:0:13264:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123229.000411:0:13264:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123229.000413:0:13264:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123229.000466:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f34421d9a00/0x7e1648d68fc91a5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e1648d68fc91a63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123229.000478:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34421d9a00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1789123229.000653:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f34421d9a00/0x7e1648d68fc91a5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e1648d68fc91a63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123229.000665:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f34421d9a00/0x7e1648d68fc91a5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e1648d68fc91a63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789123229.000672:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f34421d9a00/0x7e1648d68fc91a5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e1648d68fc91a63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123229.000678:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789123229.000680:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789123229.000683:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789123229.000713:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f34421d9a00/0x7e1648d68fc91a5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7e1648d68fc91a63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123229.000733:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789123229.000757:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f34421d9a00/0x7e1648d68fc91a5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7e1648d68fc91a63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123229.000765:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f34421d9a00/0x7e1648d68fc91a5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7e1648d68fc91a63 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123229.000782:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123229.000784:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123229.000786:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123229.000793:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789123229.000806:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c30b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381264896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789123229.000930:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123229.000972:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381264896 00000100:00100000:2.0:1789123229.000978:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381264896 00000100:00100000:2.0:1789123229.001019:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789123229.001027:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+16:3302:x1876031381264896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789123229.001039:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123229.001052:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f343bd33a00/0x7e1648d68fc91a63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7e1648d68fc91a5c expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123229.001066:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123229.001098:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd41f4a0-f4e3-41a1-856e-0c34af912023+15:3302:x1876031381264896:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123229.001105:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789123229.001142:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c30b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd41f4a0-f4e3-41a1-856e-0c34af912023:3302:1876031381264896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789123229.001485:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34063c9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd41f4a0-f4e3-41a1-856e-0c34af912023+14:3304:x1876031381264384:12345-0@lo:103:ldlm_bl.0 Request processed in 2398us (4556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123229.001495:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789123229.002205:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343585f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381264384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789123229.002217:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343585c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381264256:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1789123229.009545:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f33012b1000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1789123229.009656:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f33012b4800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789123229.009680:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f343b9ae000 for lustre-MDT0000 00000020:00000080:2.0:1789123229.009685:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f33012b4000 for lustre-MDT0000 00000100:00100000:2.0:1789123229.009706:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34354f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876031381264512:0@lo:9:umount.0 00000100:00100000:2.0:1789123229.009785:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123229.009917:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062da940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876031381264640:0@lo:9:umount.0 00000100:00100000:2.0:1789123229.009948:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123229.009989:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381264512 00000100:00100000:2.0:1789123229.009996:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381264512 00000100:00100000:2.0:1789123229.010036:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381264640 00000100:00100000:2.0:1789123229.010038:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381264640 00000100:00100000:2.0:1789123229.010080:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789123229.010089:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876031381264512:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789123229.010132:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc919b4 00000100:00080000:2.0:1789123229.010141:0:6686:0:(import.c:65:import_set_state_nolock()) ffff9f34067c6000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789123229.010190:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1789123229.010250:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789123229.010263:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876031381264640:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789123229.010289:0:6688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc91a8d 00000100:00080000:3.0:1789123229.010294:0:6688:0:(import.c:65:import_set_state_nolock()) ffff9f343592f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789123229.010321:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1789123229.010710:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3301:x1876031381264640:12345-0@lo:9:umount.0 Request processed in 450us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123229.010719:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789123229.010729:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3301:x1876031381264512:12345-0@lo:9:umount.0 Request processed in 640us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123229.010738:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:3.0:1789123229.010743:0:13264:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789123229.010764:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789123229.010876:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9f34067c2800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789123229.010899:0:3301:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789123229.010901:0:3301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789123229.010906:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34354f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876031381264512:0@lo:9:umount.0 00000100:00080000:1.0:1789123229.010918:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9f3406276800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789123229.010929:0:3301:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789123229.010930:0:3301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789123229.010934:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062da940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876031381264640:0@lo:9:umount.0 00010000:00010000:2.0:1789123229.011128:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789123229.015099:0:13263:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9f3407c51a48) has no exports 00000020:00000080:0.0:1789123229.098311:0:13263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc9186b 00000020:00000080:0.0:1789123229.098324:0:13263:0:(genops.c:885:class_export_put()) final put ffff9f3407811000/lustre-QMT0000_UUID 00000020:01000000:0.0:1789123229.098439:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1789123229.098519:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789123229.098530:0:13263:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789123229.098534:0:13263:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9f343656b490) has no exports 00000020:00000080:3.0:1789123229.098834:0:13263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc91864 00000020:00000080:3.0:1789123229.098840:0:13263:0:(genops.c:885:class_export_put()) final put ffff9f343657c800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789123229.098911:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f3407811000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1789123229.103825:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789123229.103842:0:13263:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789123229.103848:0:13263:0:(genops.c:885:class_export_put()) final put ffff9f3407816800/lustre-QMT0000_UUID 00000020:00000080:3.0:1789123229.103852:0:13263:0:(genops.c:844:class_export_destroy()) destroying export ffff9f3407816800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1789123229.103865:0:13263:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1789123229.104056:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f343657c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1789123229.189969:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789123229.217902:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 949e01ae-fd37-4d7e-878c-bf5e18b249e6 00000001:00080000:2.0:1789123229.217918:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1789123229.217922:0:5862:0:(genops.c:885:class_export_put()) final put ffff9f33012b3800/949e01ae-fd37-4d7e-878c-bf5e18b249e6 00000001:00100000:2.0:1789123229.217945:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 64de9449-4320-4c9f-abcb-230edd2b11ae 00000001:00080000:2.0:1789123229.217950:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1789123229.217968:0:5862:0:(genops.c:885:class_export_put()) final put ffff9f343592b800/64de9449-4320-4c9f-abcb-230edd2b11ae 00000020:00000080:0.0:1789123229.218014:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f33012b3800/949e01ae-fd37-4d7e-878c-bf5e18b249e6 for lustre-MDT0000 00000020:00000080:0.0:1789123229.218079:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f343592b800/64de9449-4320-4c9f-abcb-230edd2b11ae for lustre-MDT0000 00000020:00000080:0.0:1789123229.218113:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f33012b0000 for lustre-MDT0000 00000020:00000080:0.0:1789123229.218118:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f343bd29800 for lustre-MDT0000 00000001:00100000:2.0:1789123229.801651:0:12782:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789123229.801661:0:12782:0:(genops.c:885:class_export_put()) final put ffff9f3435929000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789123229.801825:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f3435929000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789123229.801874:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f343592f800 for lustre-OST0001 00010000:00010000:3.0:1789123230.213503:0:13264:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789123230.240916:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789123230.240924:0:6710:0:(genops.c:885:class_export_put()) final put ffff9f34067c2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789123230.240965:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f34067c2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789123230.241008:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f34067c6000 for lustre-OST0000 00000020:01000000:3.0:1789123231.108939:0:13263:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9f3441ed3d80 - data ffff9f3427feb000/ffff9f3301c06800 00000020:01000000:3.0:1789123231.109088:0:13263:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9f3441ed1c00 - data ffff9f342a3535e8/ffff9f343b985800 00000001:00000004:3.0:1789123231.119282:0:13263:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00010000:00010000:3.0:1789123231.239985:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789123231.253486:0:13263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789123231.253495:0:13263:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1789123231.253518:0:13263:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789123231.253521:0:13263:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789123231.253851:0:7157:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789123231.253856:0:7157:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1789123231.253865:0:7157:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1789123231.254868:0:13263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789123231.254873:0:13263:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1789123231.254890:0:13263:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789123231.254892:0:13263:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789123231.257576:0:7673:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789123231.257584:0:7673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1789123231.257598:0:7673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789123231.392501:0:13263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc91833 00000020:00000080:0.0:1789123231.392516:0:13263:0:(genops.c:885:class_export_put()) final put ffff9f3421022000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789123231.392933:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f3421022000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789123231.399229:0:13263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc91848 00000020:00000080:1.0:1789123231.399243:0:13263:0:(genops.c:885:class_export_put()) final put ffff9f342047c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789123231.399269:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789123231.399278:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789123231.399286:0:13263:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789123231.399291:0:13263:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9f3407c50000) has no exports 00000004:01000000:1.0:1789123231.399454:0:13263:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789123231.399462:0:13263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc91a86 00000020:00000080:1.0:1789123231.399466:0:13263:0:(genops.c:885:class_export_put()) final put ffff9f343bd2f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789123231.399471:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789123231.399474:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789123231.399481:0:13263:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789123231.399483:0:13263:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9f3436568000) has no exports 00000020:00000080:1.0:1789123231.399489:0:13263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc91a7f 00000020:00000080:1.0:1789123231.399492:0:13263:0:(genops.c:885:class_export_put()) final put ffff9f3406271800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789123231.399838:0:13263:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789123231.399843:0:13263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789123231.399847:0:13263:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1789123231.399852:0:13263:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789123231.399855:0:13263:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789123231.399898:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789123231.399905:0:13263:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789123231.399910:0:13263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc9199f 00000020:00000080:1.0:1789123231.399914:0:13263:0:(genops.c:885:class_export_put()) final put ffff9f3301312000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789123231.399918:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789123231.399921:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789123231.399924:0:13263:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789123231.399926:0:13263:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9f342d8a8000) has no exports 00000020:00000080:1.0:1789123231.399930:0:13263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc91998 00000020:00000080:1.0:1789123231.399933:0:13263:0:(genops.c:885:class_export_put()) final put ffff9f3301316800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789123231.400243:0:13263:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789123231.400247:0:13263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789123231.400261:0:13263:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1789123231.400264:0:13263:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789123231.400266:0:13263:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789123231.400289:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789123231.400294:0:13263:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789123231.400314:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789123231.400317:0:13263:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789123231.400339:0:13263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc9184f 00000020:00000080:1.0:1789123231.400343:0:13263:0:(genops.c:885:class_export_put()) final put ffff9f3420478800/lustre-MDD0000_UUID 00000020:01000000:1.0:1789123231.400347:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789123231.400350:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789123231.400353:0:13263:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789123231.400355:0:13263:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9f342d8aced8) has no exports 00000020:00000080:1.0:1789123231.400372:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789123231.400375:0:13263:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1789123231.400378:0:13263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc91856 00000020:00000080:1.0:1789123231.400381:0:13263:0:(genops.c:885:class_export_put()) final put ffff9f342047c800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789123231.400387:0:13263:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f3408401800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1789123231.400390:0:13263:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f3408401800 3 00000020:01000004:1.0:1789123231.400392:0:13263:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f3408401800 from lustre-MDT0000 00000020:00000080:1.0:1789123231.400408:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789123231.400411:0:13263:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1789123231.400414:0:13263:0:(genops.c:885:class_export_put()) final put ffff9f3421026000/lustre-MDT0000_UUID 00000020:00000080:1.0:1789123231.400416:0:13263:0:(genops.c:844:class_export_destroy()) destroying export ffff9f3421026000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1789123231.400424:0:13263:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1789123231.400481:0:13263:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1789123231.400485:0:13263:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1789123231.400488:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1789123231.400490:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789123231.400492:0:13263:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789123231.400498:0:13263:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9f3418437000 dd41f4a0-f4e3-41a1-856e-0c34af912023 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789123231.400503:0:13263:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9f3407be9a48) has exports, disconnecting them 00000020:00080000:1.0:1789123231.400507:0:13263:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9f3418437000), last request at 1789122998 00000020:00000080:1.0:1789123231.400524:0:13263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc917f4 00000020:00010000:1.0:1789123231.400528:0:13263:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9f3418437000: total 7 00000100:00080000:1.0:1789123231.400531:0:13263:0:(import.c:65:import_set_state_nolock()) ffff9f3403912800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789123231.400549:0:13263:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f3418437000): rc 0 00000020:00080000:1.0:1789123231.400553:0:13263:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9f3407be9a48) has no exports 00000100:00100000:1.0:1789123231.400643:0:5833:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9f34060cf800:5833] 0 exiting: rc = 1 00000100:00100000:1.0:1789123231.400763:0:5835:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9f3407b59600:5835] 2 exiting: rc = 0 00000020:00000080:0.0:1789123231.400936:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f342047c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1789123231.400942:0:8:0:(genops.c:885:class_export_put()) final put ffff9f343b0d6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789123231.400944:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f343b0d6000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789123231.400948:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789123231.401048:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f343bd2f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789123231.401054:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f3406271800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789123231.401059:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f3406276800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789123231.401064:0:8:0:(genops.c:885:class_export_put()) final put ffff9f3405da8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789123231.401065:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f3405da8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789123231.401068:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789123231.401095:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f3301312000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789123231.401099:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f3301316800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789123231.401104:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f34067c2800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789123231.401107:0:8:0:(genops.c:885:class_export_put()) final put ffff9f3301312800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789123231.401109:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f3301312800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789123231.401112:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789123231.401184:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f3420478800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1789123231.401189:0:8:0:(genops.c:885:class_export_put()) final put ffff9f3403cc8800/lustre-MDD0000_UUID 00000020:00000080:0.0:1789123231.401191:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f3403cc8800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1789123231.401194:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1789123231.401328:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f342047c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:3.0:1789123231.401389:0:5827:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9f3418437000: total 0 00010000:00010000:3.0:1789123231.401421:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f3418437000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1789123231.401449:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3435b52e00/0x7e1648d68fc91d7a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7e1648d68fc91d73 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123231.401472:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3400031000/0x7e1648d68fc91b4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7e1648d68fc91b43 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123231.401497:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f342d80b200/0x7e1648d68fc91d88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7e1648d68fc91d81 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123231.401511:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3400030e00/0x7e1648d68fc9190c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7e1648d68fc91905 expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123231.401522:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3400030800/0x7e1648d68fc91af6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7e1648d68fc91aef expref: 5 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123231.401531:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3400031800/0x7e1648d68fc91b04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7e1648d68fc91afd expref: 4 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123231.401540:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3401515200/0x7e1648d68fc91b20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7e1648d68fc91b19 expref: 3 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123231.401550:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f342d80b000/0x7e1648d68fc91b12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7e1648d68fc91b0b expref: 2 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123231.401558:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f3418437000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1789123231.401571:0:5827:0:(genops.c:885:class_export_put()) final put ffff9f3418437000/dd41f4a0-f4e3-41a1-856e-0c34af912023 00010000:00010000:3.0:1789123231.401591:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123231.401593:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123231.401595:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789123231.401910:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f3418437000/dd41f4a0-f4e3-41a1-856e-0c34af912023 for MGS 00000020:00000080:0.0:1789123231.401941:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f3403912800 for MGS 00000100:00100000:0.0:1789123231.403741:0:5834:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9f3408554800:5834] 1 exiting: rc = 0 00000100:00100000:1.0:1789123231.406713:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406724:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406729:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406735:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406741:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406746:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406752:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406758:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406764:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406770:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406776:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406783:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406798:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406804:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406809:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406814:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406818:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406824:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406829:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406833:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406839:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406844:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406849:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406853:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406858:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406863:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406868:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406897:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406902:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406906:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406911:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406916:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406921:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406926:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406930:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406935:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406939:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406944:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406949:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406954:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406958:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406963:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406968:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406973:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406978:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406982:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406987:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406992:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.406996:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.407001:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.407006:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.407010:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.407015:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.407019:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.407024:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.407029:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.407038:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.407043:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.407435:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.407445:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.407450:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.407456:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.407470:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.407477:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1789123231.408369:0:13263:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789123231.408374:0:13263:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1789123231.409455:0:13263:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9f34049a2ba0 - data ffff9f343ffab000/ffff9f3408422800 00000020:01000000:1.0:1789123231.409881:0:13263:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9f34137b9120 - data ffff9f342a367bd0/ffff9f34066a0000 00000020:00000080:1.0:1789123231.412130:0:13263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc917d8 00000020:00000080:1.0:1789123231.412141:0:13263:0:(genops.c:885:class_export_put()) final put ffff9f3407973800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789123231.412276:0:13263:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f3408401800 from MGS, refs=2 00000020:01000004:1.0:1789123231.412280:0:13263:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f3408401800 2 00000020:01000004:1.0:1789123231.412282:0:13263:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f3408401800 from MGS 00000020:00000080:1.0:1789123231.412310:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789123231.412318:0:13263:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789123231.412321:0:13263:0:(genops.c:885:class_export_put()) final put ffff9f3403912000/MGS 00000020:00000080:1.0:1789123231.412324:0:13263:0:(genops.c:844:class_export_destroy()) destroying export ffff9f3403912000/MGS for MGS 00000020:01000000:1.0:1789123231.412331:0:13263:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789123231.412389:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789123231.412393:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789123231.412398:0:13263:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789123231.412405:0:13263:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9f3408863000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789123231.412410:0:13263:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9f3407beced8) has exports, disconnecting them 00000020:00080000:1.0:1789123231.412414:0:13263:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9f3408863000), last request at 1789122999 00000020:00000080:1.0:1789123231.412419:0:13263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc918a3 00000020:00080000:1.0:1789123231.412430:0:13263:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f3408863000): rc 0 00000020:00000080:1.0:1789123231.412434:0:13263:0:(genops.c:885:class_export_put()) final put ffff9f3408863000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789123231.419808:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f3407973800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789123231.420893:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f3408863000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1789123231.434780:0:13263:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1789123231.434789:0:13263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789123231.434794:0:13263:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789123231.434802:0:13263:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789123231.434838:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f343bd1a800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789123231.435040:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789123231.435064:0:13263:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1789123231.435070:0:13263:0:(genops.c:885:class_export_put()) final put ffff9f343bd1c000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789123231.435073:0:13263:0:(genops.c:844:class_export_destroy()) destroying export ffff9f343bd1c000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1789123231.435080:0:13263:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1789123231.435135:0:13263:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f3408401800 1 00000020:00000080:1.0:1789123231.435141:0:13263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc917ca 00000020:00000080:1.0:1789123231.435158:0:13263:0:(genops.c:885:class_export_put()) final put ffff9f3403910000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1789123231.435174:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1789123231.435178:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789123231.435182:0:13263:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789123231.435185:0:13263:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9f3407be8000) has no exports 00000020:00000080:0.0:1789123231.435309:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f3403910000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789123231.508306:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789123231.508319:0:13263:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1789123231.508326:0:13263:0:(genops.c:885:class_export_put()) final put ffff9f3408402800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789123231.508331:0:13263:0:(genops.c:844:class_export_destroy()) destroying export ffff9f3408402800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789123231.508340:0:13263:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1789123231.508455:0:13263:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9f3408401000 00000020:01000000:1.0:1789123231.508475:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1789123231.508479:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789123231.508482:0:13263:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789123231.508486:0:13263:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9f3407c53490) has no exports 00000100:00100000:3.0:1789123231.512527:0:5841:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9f3410048e00:5841] 1 exiting: rc = 0 00000100:00100000:2.0:1789123231.513191:0:5842:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9f3410049a00:5842] 2 exiting: rc = 0 00000100:00100000:0.0:1789123231.513579:0:5840:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9f3407dbfa00:5840] 0 exiting: rc = 1 00000100:00100000:0.0:1789123231.515546:0:7640:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9f3435918c00:7640] 3 exiting: rc = 0 00000100:00100000:1.0:1789123231.516836:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516844:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516850:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516855:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516861:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516865:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516871:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516876:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516879:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516883:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516887:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516890:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516905:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516908:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516914:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516917:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516921:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516924:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516928:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516930:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516933:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516936:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516940:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516943:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516946:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516949:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516952:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516955:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516959:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516962:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516965:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516969:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516972:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516974:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516978:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516981:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516984:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516989:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516993:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516996:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.516999:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.517002:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.517006:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.517009:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.517011:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.517014:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.517017:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.517024:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.517027:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.517031:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.517034:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.517039:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.517044:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.517049:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.517054:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.517059:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.517064:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.517069:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.517075:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.517080:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.517091:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.517097:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.517103:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.517108:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.520471:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9f3407dbcc00:5843] 0 exiting: rc = 1 00000100:00100000:3.0:1789123231.520606:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9f3410048200:5844] 1 exiting: rc = 0 00000100:00100000:1.0:1789123231.520673:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520683:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520689:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520694:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520698:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520701:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520706:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520711:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520716:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520721:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520725:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520729:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520733:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520736:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520740:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520744:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520747:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520750:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520763:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520767:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520770:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520773:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520777:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520780:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520783:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520786:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520789:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520792:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520794:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520797:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520800:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520803:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520806:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520808:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520812:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520815:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520818:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520821:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520824:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520827:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520830:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520835:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520839:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520843:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520846:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520850:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520854:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520857:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520861:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520865:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520869:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520872:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520877:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520885:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520890:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520895:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520900:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520904:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520910:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520914:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520917:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520921:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520925:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.520929:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.521575:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9f3407dbc200:5846] 1 exiting: rc = 0 00000100:00100000:3.0:1789123231.521892:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9f3407dbde00:5845] 0 exiting: rc = 1 00000100:00100000:1.0:1789123231.522010:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522016:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522021:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522027:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522032:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522037:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522043:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522049:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522057:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522065:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522071:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522079:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522100:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522107:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522112:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522118:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522123:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522141:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522154:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522159:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522165:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522171:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522176:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522182:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522211:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522217:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522223:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522229:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522238:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522243:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522248:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522253:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522259:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522264:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522270:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522275:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522293:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522299:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522304:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522310:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522315:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522322:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522327:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522332:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522338:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522344:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522350:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522357:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522377:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522384:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522390:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522395:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522402:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522407:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522413:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522419:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522425:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522431:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522437:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522452:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522472:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522480:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522485:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.522492:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.534443:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9f34062a2800:5848] 1 exiting: rc = 0 00000100:00100000:0.0:1789123231.534622:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9f34062a2a00:5847] 0 exiting: rc = 1 00000100:00100000:3.0:1789123231.534915:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.534921:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.534927:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.534932:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.534938:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.534943:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.534947:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.534952:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.534957:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.534962:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.534966:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.534971:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.534976:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.534981:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.534986:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.534991:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.534996:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535001:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535006:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535011:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535016:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535020:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535025:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535030:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535035:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535040:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535044:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535049:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535053:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535058:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535062:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535081:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535086:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535091:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535096:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535101:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535106:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535111:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535116:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535121:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535126:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535208:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535216:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535221:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535225:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535230:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535234:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535239:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535244:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535249:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535254:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535258:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535263:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535268:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535274:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535279:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535283:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535289:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535295:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535300:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535305:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535310:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535315:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.535320:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.536215:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9f3406770e00:5850] 1 exiting: rc = 0 00000100:00100000:0.0:1789123231.536350:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9f3406770400:5849] 0 exiting: rc = 1 00000100:00100000:3.0:1789123231.536675:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.536682:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.536697:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.536702:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.536707:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.536712:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.536716:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.536722:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.536728:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.536734:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.536739:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.536744:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.536749:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.536754:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.536758:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.536763:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.536768:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.536940:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.536949:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.536955:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.536960:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.536965:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.536970:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.536975:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.536980:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.536985:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.536989:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.536994:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.536999:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537003:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537008:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537013:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537017:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537022:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537027:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537032:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537037:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537050:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537055:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537060:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537065:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537070:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537075:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537080:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537085:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537090:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537095:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537100:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537105:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537110:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537115:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537119:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537124:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537129:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537216:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537221:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537226:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537230:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537235:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537239:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537244:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537249:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537254:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789123231.537258:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.538345:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9f3406770600:5851] 0 exiting: rc = 1 00000100:00100000:3.0:1789123231.538453:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9f3406771c00:5852] 1 exiting: rc = 0 00000100:00100000:0.0:1789123231.539003:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539009:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539014:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539019:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539023:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539028:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539033:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539038:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539044:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539050:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539055:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539060:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539066:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539070:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539075:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539079:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539095:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539101:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539107:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539111:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539117:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539122:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539127:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539211:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539217:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539222:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539227:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539231:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539236:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539241:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539245:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539249:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539254:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539258:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539263:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539268:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539272:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539276:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539282:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539287:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539293:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539298:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539303:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539308:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539312:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539316:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539321:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539325:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539329:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539334:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539339:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539352:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539357:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539362:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539367:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539371:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539376:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539381:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539386:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539391:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539397:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539402:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539406:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123231.539411:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.541385:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9f3406770a00:5853] 0 exiting: rc = 1 00000100:00100000:0.0:1789123231.542554:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9f3406770200:5855] 2 exiting: rc = 0 00000100:00100000:3.0:1789123231.542913:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9f3406770000:5854] 1 exiting: rc = 0 00000100:00100000:1.0:1789123231.543012:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543020:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543026:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543031:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543037:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543042:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543048:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543053:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543058:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543063:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543068:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543073:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543093:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543099:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543104:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543108:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543113:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543117:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543123:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543128:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543152:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543159:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543164:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543169:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543174:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543182:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543187:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543209:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543215:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543219:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543225:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543229:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543234:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543239:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543244:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543250:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543270:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543277:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543284:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543289:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543295:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543300:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543306:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543312:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543318:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543323:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543329:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543335:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543341:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543346:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543352:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543357:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543362:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543367:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543371:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543376:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543381:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543387:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543392:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543399:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543418:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543425:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543438:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123231.543443:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789123231.548975:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789123231.548987:0:13263:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1789123231.548993:0:13263:0:(genops.c:885:class_export_put()) final put ffff9f342044d000/MDS_uuid 00000020:00000080:1.0:1789123231.548999:0:13263:0:(genops.c:844:class_export_destroy()) destroying export ffff9f342044d000/MDS_uuid for MDS 00000020:01000000:1.0:1789123231.549005:0:13263:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1789123231.549128:0:13263:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:3.0:1789123231.754952:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381265024:0@lo:400:kworker.0 00000400:00000100:3.0:1789123231.755009:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876031381265024 offset 0 length 224: 4 00000100:00100000:3.0:1789123231.757879:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789123231.757902:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381265152:0@lo:400:kworker.0 00000400:00000100:3.0:1789123231.757960:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876031381265152 offset 0 length 224: 4 00000100:00100000:3.0:1789123231.758767:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876031381265280:0@lo:400:kworker.0 00000400:00000100:3.0:1789123231.758796:0:3302:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876031381265280 offset 0 length 224: 4 00010000:00010000:3.0:1789123232.260867:0:13264:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123233.284788:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789123233.961234:0:13419:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1789123233.974821:0:13419:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1789123233.974863:0:13419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3400031c00/0x7e1648d68fc91b0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b12 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123233.974878:0:13419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3400031c00/0x7e1648d68fc91b0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91b12 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123233.974886:0:13419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3400031c00/0x7e1648d68fc91b0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e1648d68fc91b12 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123233.974893:0:13419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9f3400031c00/0x7e1648d68fc91b0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e1648d68fc91b12 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123233.975052:0:13419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789123233.975058:0:13419:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789123233.975084:0:13419:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789123233.975094:0:13419:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f34062db480 x1876031381265152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123247 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123233.975173:0:13419:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789123233.975180:0:13419:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789123233.975202:0:13419:0:(import.c:65:import_set_state_nolock()) ffff9f3301317800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1789123233.976258:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789123233.976267:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f3400031c00/0x7e1648d68fc91b0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e1648d68fc91b12 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123233.976276:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3400031c00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:3.0:1789123233.976280:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f3400031c00/0x7e1648d68fc91b0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e1648d68fc91b12 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123233.976290:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f3400031c00/0x7e1648d68fc91b0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e1648d68fc91b12 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789123233.976297:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f3400031c00/0x7e1648d68fc91b0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e1648d68fc91b12 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789123233.976303:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789123233.976305:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789123233.976308:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789123233.976344:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f3400031c00/0x7e1648d68fc91b0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x7e1648d68fc91b12 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123233.976351:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789123233.976377:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f3400031c00/0x7e1648d68fc91b0b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x7e1648d68fc91b12 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123233.976384:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f3400031c00/0x7e1648d68fc91b0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x7e1648d68fc91b12 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123233.976410:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123233.976412:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123233.976414:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123233.976431:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062c8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd41f4a0-f4e3-41a1-856e-0c34af912023:3303:1876031381265536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789123233.976497:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123233.976574:0:11614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381265536 00000100:00100000:3.0:1789123233.976581:0:11614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381265536 00000100:00100000:3.0:1789123233.976647:0:11614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789123233.976655:0:11614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3303:x1876031381265536:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789123233.976661:0:11614:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789123233 with bad export cookie 9085529384639076340 00000100:00100000:2.0:1789123233.979614:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381265152:0@lo:400:kworker.0 00000100:00100000:1.0:1789123233.981400:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1876031381265408:0@lo:39:umount.0 00000400:00000100:1.0:1789123233.981452:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876031381265408 offset 0 length 224: 4 00000100:00100000:3.0:1789123233.991411:0:11614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3303:x1876031381265536:12345-0@lo:103:ldlm_bl.0 Request processed in 14747us (14905us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789123233.991425:0:11614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1789123233.991499:0:3303:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789123233.991504:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9f342044e000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789123233.991508:0:3303:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1789123234.002952:0:3303:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.130@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789123234.002959:0:3303:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789123234.002969:0:3303:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f34062d92c0 x1876031381265024/t0(0) o400->MGC192.168.206.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789123247 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123234.002990:0:3303:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f34062c8780 x1876031381265536/t0(0) o103->MGC192.168.206.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789123249 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789123234.002999:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789123234.003002:0:3303:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789123234.003004:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789123234.003007:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9f342044e000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789123234.003012:0:3303:0:(import.c:510:import_select_connection()) MGC192.168.206.130@tcp: connect to NID 0@lo last attempt 113 00000100:00080000:0.0:1789123234.003021:0:3303:0:(import.c:624:import_select_connection()) MGC192.168.206.130@tcp: import ffff9f342044e000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:0.0:1789123234.003054:0:3303:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f34062dad00 x1876031381265664/t0(0) o250->MGC192.168.206.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789123234.003096:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062c8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd41f4a0-f4e3-41a1-856e-0c34af912023:3303:1876031381265536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789123234.003142:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd41f4a0-f4e3-41a1-856e-0c34af912023:3304:1876031381265024:0@lo:400:kworker.0 00000100:00100000:1.0:1789123234.003178:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd41f4a0-f4e3-41a1-856e-0c34af912023:3301:1876031381265664:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:1.0:1789123234.003224:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876031381265664 offset 0 length 520: 4 00010000:00010000:3.0:1789123234.310910:0:13264:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123235.332797:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123236.356903:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789123236.868755:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) dd41f4a0-f4e3-41a1-856e-0c34af912023->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789123236.868766:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) dd41f4a0-f4e3-41a1-856e-0c34af912023->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789123236.869012:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876031381265792:0@lo:400:kworker.0 00000400:00000100:3.0:1789123236.869063:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876031381265792 offset 0 length 224: 4 00010000:00010000:3.0:1789123237.381269:0:13264:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123238.405189:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789123238.919147:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) dd41f4a0-f4e3-41a1-856e-0c34af912023->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789123238.919157:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) dd41f4a0-f4e3-41a1-856e-0c34af912023->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789123238.919312:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381265920:0@lo:400:kworker.0 00000400:00000100:1.0:1789123238.919364:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876031381265920 offset 0 length 224: 4 00010000:00010000:3.0:1789123239.428880:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123240.454887:0:13264:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123241.477226:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123242.509862:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123243.140857:0:3301:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789123233/real 1789123233] req@ffff9f34062dbc00 x1876031381265408/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789123243 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123243.140895:0:3301:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f34062dbc00 x1876031381265408/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789123243 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789123243.140914:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9f3301317800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789123243.140935:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1876031381265408:0@lo:39:umount.0 00000100:00080000:0.0:1789123243.141029:0:13419:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789123243.141035:0:13419:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789123243.141047:0:13419:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789123243.141985:0:13419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401515600/0x7e1648d68fc91b19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b20 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123243.141999:0:13419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401515600/0x7e1648d68fc91b19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91b20 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123243.142006:0:13419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401515600/0x7e1648d68fc91b19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e1648d68fc91b20 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123243.142013:0:13419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9f3401515600/0x7e1648d68fc91b19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e1648d68fc91b20 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123243.142042:0:13419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789123243.142050:0:13419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91d81 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91d88 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123243.142057:0:13419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91d81 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91d88 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123243.142062:0:13419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91d81 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e1648d68fc91d88 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123243.142068:0:13419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91d81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e1648d68fc91d88 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123243.142098:0:13419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789123243.142103:0:13419:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1789123243.142152:0:13419:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789123243.142157:0:13419:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1789123243.142162:0:13419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789123243.142166:0:13419:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789123243.142170:0:13419:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9f343bd01a48) has no exports 00000020:00080000:0.0:1789123243.142356:0:13419:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9f343bd01a48) has no exports 00010000:00010000:3.0:1789123243.142901:0:13264:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789123243.142921:0:13264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f3401515600/0x7e1648d68fc91b19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e1648d68fc91b20 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123243.142930:0:13264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401515600 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:3.0:1789123243.142934:0:13264:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f3401515600/0x7e1648d68fc91b19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e1648d68fc91b20 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123243.142943:0:13264:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f3401515600/0x7e1648d68fc91b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e1648d68fc91b20 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789123243.142951:0:13264:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f3401515600/0x7e1648d68fc91b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e1648d68fc91b20 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789123243.142956:0:13264:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789123243.142959:0:13264:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1789123243.142962:0:13264:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1789123243.142973:0:13264:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f342044e000 00010000:00010000:3.0:1789123243.142977:0:13264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f3401515600/0x7e1648d68fc91b19 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e1648d68fc91b20 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123243.142984:0:13264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f3401515600/0x7e1648d68fc91b19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e1648d68fc91b20 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123243.142999:0:13264:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789123243.143002:0:13264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91d81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e1648d68fc91d88 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123243.143007:0:13264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f34029f2600 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:3.0:1789123243.143010:0:13264:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91d81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e1648d68fc91d88 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123243.143026:0:13264:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91d81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e1648d68fc91d88 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789123243.143033:0:13264:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91d81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e1648d68fc91d88 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789123243.143038:0:13264:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789123243.143041:0:13264:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789123243.143042:0:13264:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789123243.143048:0:13264:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f342044e000 00010000:00010000:3.0:1789123243.143051:0:13264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91d81 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e1648d68fc91d88 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123243.143057:0:13264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f34029f2600/0x7e1648d68fc91d81 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e1648d68fc91d88 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123243.143066:0:13264:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123243.143068:0:13264:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123243.143070:0:13264:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123243.143686:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789123243.149483:0:13419:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9f34049a28a0 - data ffff9f343ffab438/ffff9f3408427400 00000020:01000000:0.0:1789123243.149841:0:13419:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9f3418257d80 - data ffff9f3427f1fe58/ffff9f3436e8e400 00100000:10000000:0.0:1789123243.165563:0:13419:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789123243.231543:0:13419:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc91928 00000020:00000080:3.0:1789123243.231553:0:13419:0:(genops.c:885:class_export_put()) final put ffff9f3405d41000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1789123243.231575:0:13419:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f343be04000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1789123243.231578:0:13419:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f343be04000 2 00000020:01000004:3.0:1789123243.231582:0:13419:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f343be04000 from lustre-OST0000 00000020:00000080:3.0:1789123243.231605:0:13419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789123243.231614:0:13419:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1789123243.231618:0:13419:0:(genops.c:885:class_export_put()) final put ffff9f3441fba800/lustre-OST0000_UUID 00000020:00000080:3.0:1789123243.231620:0:13419:0:(genops.c:844:class_export_destroy()) destroying export ffff9f3441fba800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1789123243.231649:0:13419:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1789123243.231690:0:13419:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1789123243.231706:0:13419:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789123243.231709:0:13419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789123243.231715:0:13419:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789123243.231721:0:13419:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9f33012b0800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789123243.231727:0:13419:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9f342d8ab490) has exports, disconnecting them 00000020:00080000:3.0:1789123243.231732:0:13419:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9f33012b0800), last request at 1789123014 00000020:00000080:3.0:1789123243.231735:0:13419:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc91952 00000020:00080000:3.0:1789123243.231746:0:13419:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f33012b0800): rc 0 00000020:00000080:3.0:1789123243.231751:0:13419:0:(genops.c:885:class_export_put()) final put ffff9f33012b0800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789123243.232483:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f3405d41000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789123243.232497:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f33012b0800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789123243.232677:0:13419:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789123243.232681:0:13419:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789123243.232685:0:13419:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789123243.232694:0:13419:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789123243.232839:0:13419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789123243.232845:0:13419:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1789123243.232850:0:13419:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f343be04000 1 00000020:00000080:2.0:1789123243.232854:0:13419:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc918e2 00000020:00000080:2.0:1789123243.232859:0:13419:0:(genops.c:885:class_export_put()) final put ffff9f343bd1a000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789123243.232863:0:13419:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789123243.232868:0:13419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789123243.232871:0:13419:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789123243.232874:0:13419:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9f34066ab490) has no exports 00000020:00000080:0.0:1789123243.234062:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f3301317800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789123243.234073:0:36:0:(genops.c:885:class_export_put()) final put ffff9f340490e000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1789123243.234077:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f340490e000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1789123243.234100:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1789123243.234152:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f343bd1a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789123243.258120:0:13419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789123243.258134:0:13419:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1789123243.258140:0:13419:0:(genops.c:885:class_export_put()) final put ffff9f3436578000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789123243.258144:0:13419:0:(genops.c:844:class_export_destroy()) destroying export ffff9f3436578000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1789123243.258151:0:13419:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1789123243.258339:0:13419:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9f343be01000 00000020:02000400:0.0:1789123243.258392:0:13419:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1789123243.525016:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789123244.050919:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) dd41f4a0-f4e3-41a1-856e-0c34af912023->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789123244.050927:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) dd41f4a0-f4e3-41a1-856e-0c34af912023->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789123244.051012:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c30a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876031381266048:0@lo:400:kworker.0 00000400:00000100:2.0:1789123244.051067:0:3302:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876031381266048 offset 0 length 224: 4 00000100:00100000:2.0:1789123244.167680:0:3301:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789123234/real 1789123234] req@ffff9f34062dad00 x1876031381265664/t0(0) o250->MGC192.168.206.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789123244 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123244.167727:0:3301:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f34062dad00 x1876031381265664/t0(0) o250->MGC192.168.206.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789123244 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789123244.167748:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9f342044e000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789123244.167764:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1789123244.167769:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd41f4a0-f4e3-41a1-856e-0c34af912023:3301:1876031381265664:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:0.0:1789123244.167873:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) dd41f4a0-f4e3-41a1-856e-0c34af912023->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789123244.167878:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1789123244.167881:0:8:0:(import.c:65:import_set_state_nolock()) ffff9f342044e000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789123244.167886:0:8:0:(import.c:510:import_select_connection()) MGC192.168.206.130@tcp: connect to NID 0@lo last attempt 348 00000100:00080000:0.0:1789123244.167892:0:8:0:(import.c:589:import_select_connection()) MGC192.168.206.130@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789123244.167899:0:8:0:(import.c:624:import_select_connection()) MGC192.168.206.130@tcp: import ffff9f342044e000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:0.0:1789123244.167931:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f34062d8000 x1876031381266176/t0(0) o250->MGC192.168.206.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789123244.168407:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd41f4a0-f4e3-41a1-856e-0c34af912023:3301:1876031381266176:0@lo:250:kworker.0 00000400:00000100:2.0:1789123244.168455:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876031381266176 offset 0 length 520: 4 00010000:00010000:3.0:1789123244.549414:0:13264:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123245.573612:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789123245.882045:0:13573:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1789123245.898807:0:13573:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1789123245.898893:0:13573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc91aef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91af6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123245.898907:0:13573:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc91aef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91af6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123245.898914:0:13573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc91aef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e1648d68fc91af6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123245.898921:0:13573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc91aef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e1648d68fc91af6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123245.899018:0:13573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789123245.899023:0:13573:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789123245.899123:0:13573:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789123245.899135:0:13573:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f34062d9a40 x1876031381265280/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123247 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123245.899279:0:13573:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f34062db840 x1876031381265792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123252 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123245.899323:0:13573:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f34062da1c0 x1876031381265920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123254 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123245.899336:0:13573:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f343c30a1c0 x1876031381266048/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123260 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123245.899343:0:13573:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789123245.899349:0:13573:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789123245.899372:0:13573:0:(import.c:65:import_set_state_nolock()) ffff9f3441fb8000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789123245.899401:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c308f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1876031381266304:0@lo:39:umount.0 00000400:00000100:2.0:1789123245.899450:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876031381266304 offset 0 length 224: 4 00000100:00100000:1.0:1789123245.899779:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876031381265792:0@lo:400:kworker.0 00000100:00100000:1.0:1789123245.899811:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381265920:0@lo:400:kworker.0 00010000:00010000:3.0:1789123245.900655:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789123245.900664:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc91aef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e1648d68fc91af6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123245.900675:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401514a00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:3.0:1789123245.900679:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc91aef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e1648d68fc91af6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123245.900690:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc91aef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e1648d68fc91af6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789123245.900697:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc91aef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e1648d68fc91af6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789123245.900704:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789123245.900707:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789123245.900709:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789123245.900725:0:5827:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f342044e000 00010000:00010000:3.0:1789123245.900729:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc91aef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e1648d68fc91af6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123245.900751:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f3401514a00/0x7e1648d68fc91aef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e1648d68fc91af6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123245.900762:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123245.900764:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123245.900766:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123245.901449:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876031381265280:0@lo:400:kworker.0 00000100:00100000:0.0:1789123245.901477:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c30a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876031381266048:0@lo:400:kworker.0 00010000:00010000:3.0:1789123246.597853:0:13264:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123247.622023:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123248.645163:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789123249.669054:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) dd41f4a0-f4e3-41a1-856e-0c34af912023->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789123249.669090:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) dd41f4a0-f4e3-41a1-856e-0c34af912023->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1789123249.669299:0:13264:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123250.692863:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123251.717053:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123252.741406:0:13264:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123253.765174:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123254.789075:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789123254.789164:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) dd41f4a0-f4e3-41a1-856e-0c34af912023->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789123254.789170:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) dd41f4a0-f4e3-41a1-856e-0c34af912023->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789123255.046003:0:3301:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789123245/real 1789123245] req@ffff9f343c308f00 x1876031381266304/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789123255 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123255.046045:0:3301:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f343c308f00 x1876031381266304/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789123255 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789123255.046066:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9f3441fb8000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789123255.046091:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c308f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1876031381266304:0@lo:39:umount.0 00000100:00080000:1.0:1789123255.046187:0:13573:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789123255.046192:0:13573:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789123255.046197:0:13573:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789123255.047278:0:13573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401514c00/0x7e1648d68fc91afd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91b04 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123255.047292:0:13573:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401514c00/0x7e1648d68fc91afd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91b04 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123255.047299:0:13573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3401514c00/0x7e1648d68fc91afd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e1648d68fc91b04 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123255.047306:0:13573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9f3401514c00/0x7e1648d68fc91afd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e1648d68fc91b04 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123255.047333:0:13573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789123255.047341:0:13573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd32800/0x7e1648d68fc91d73 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc91d7a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123255.047348:0:13573:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd32800/0x7e1648d68fc91d73 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc91d7a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123255.047354:0:13573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd32800/0x7e1648d68fc91d73 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e1648d68fc91d7a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123255.047361:0:13573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9f343bd32800/0x7e1648d68fc91d73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7e1648d68fc91d7a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123255.048641:0:13573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789123255.048648:0:13573:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:2.0:1789123255.048674:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789123255.048682:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f3401514c00/0x7e1648d68fc91afd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e1648d68fc91b04 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123255.048690:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401514c00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1789123255.048693:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f3401514c00/0x7e1648d68fc91afd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e1648d68fc91b04 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123255.048702:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f3401514c00/0x7e1648d68fc91afd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e1648d68fc91b04 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789123255.048717:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f3401514c00/0x7e1648d68fc91afd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e1648d68fc91b04 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123255.048722:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789123255.048725:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1789123255.048727:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00000020:01000004:1.0:1789123255.048732:0:13573:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789123255.048736:0:13573:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:2.0:1789123255.048740:0:5828:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f342044e000 00000020:00000080:1.0:1789123255.048740:0:13573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:2.0:1789123255.048743:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f3401514c00/0x7e1648d68fc91afd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e1648d68fc91b04 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789123255.048745:0:13573:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789123255.048749:0:13573:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9f343bd03490) has no exports 00010000:00010000:2.0:1789123255.048750:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f3401514c00/0x7e1648d68fc91afd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e1648d68fc91b04 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123255.048763:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789123255.048766:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f343bd32800/0x7e1648d68fc91d73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e1648d68fc91d7a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123255.048772:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32800 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1789123255.048775:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f343bd32800/0x7e1648d68fc91d73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7e1648d68fc91d7a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123255.048781:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f343bd32800/0x7e1648d68fc91d73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e1648d68fc91d7a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789123255.048786:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f343bd32800/0x7e1648d68fc91d73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e1648d68fc91d7a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123255.048790:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789123255.048792:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789123255.048797:0:5828:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789123255.048802:0:5828:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f342044e000 00010000:00010000:2.0:1789123255.048805:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f343bd32800/0x7e1648d68fc91d73 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e1648d68fc91d7a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123255.048810:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f343bd32800/0x7e1648d68fc91d73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e1648d68fc91d7a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123255.048839:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123255.048841:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123255.048843:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789123255.048935:0:13573:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9f343bd03490) has no exports 00010000:00010000:3.0:1789123255.049842:0:13264:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789123255.052166:0:13573:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9f34049a2540 - data ffff9f343fe5fa20/ffff9f3408426c00 00000020:01000000:1.0:1789123255.052329:0:13573:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9f34063fbae0 - data ffff9f3427c18bd0/ffff9f330276d800 00100000:10000000:0.0:1789123255.078907:0:13573:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789123255.186771:0:13573:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc919f3 00000020:00000080:2.0:1789123255.186780:0:13573:0:(genops.c:885:class_export_put()) final put ffff9f343592f000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789123255.186793:0:13573:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f3406274800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789123255.186797:0:13573:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f3406274800 2 00000020:01000004:2.0:1789123255.186800:0:13573:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f3406274800 from lustre-OST0001 00000020:00000080:2.0:1789123255.186826:0:13573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789123255.186836:0:13573:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789123255.186839:0:13573:0:(genops.c:885:class_export_put()) final put ffff9f343592c000/lustre-OST0001_UUID 00000020:00000080:2.0:1789123255.186842:0:13573:0:(genops.c:844:class_export_destroy()) destroying export ffff9f343592c000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789123255.186849:0:13573:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789123255.186941:0:13573:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import dd41f4a0-f4e3-41a1-856e-0c34af912023->MGS 00010000:00010000:2.0:1789123255.186956:0:13573:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f34029f3e00/0x7e1648d68fc91905 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e1648d68fc9190c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789123255.186968:0:13573:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f34029f3e00/0x7e1648d68fc91905 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e1648d68fc9190c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123255.186974:0:13573:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789123255.186977:0:13573:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789123255.186980:0:13573:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789123255.186994:0:13573:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f342044e000 00010000:00010000:2.0:1789123255.187013:0:13573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f34029f3e00/0x7e1648d68fc91905 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e1648d68fc9190c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123255.187037:0:13573:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f3401514600/0x7e1648d68fc91b43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7e1648d68fc91b4a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789123255.187044:0:13573:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f3401514600/0x7e1648d68fc91b43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7e1648d68fc91b4a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123255.187050:0:13573:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789123255.187052:0:13573:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789123255.187053:0:13573:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789123255.187063:0:13573:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f342044e000 00010000:00010000:2.0:1789123255.187066:0:13573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f3401514600/0x7e1648d68fc91b43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7e1648d68fc91b4a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789123255.187081:0:13573:0:(import.c:65:import_set_state_nolock()) ffff9f342044e000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789123255.187085:0:13573:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789123255.187087:0:13573:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789123255.187089:0:13573:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789123255.187092:0:13573:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789123255.187102:0:13573:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f34062d8000 x1876031381266176/t0(0) o250->MGC192.168.206.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789123259 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789123255.187117:0:13573:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789123255.187120:0:13573:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:2.0:1789123255.187179:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd41f4a0-f4e3-41a1-856e-0c34af912023:3301:1876031381266176:0@lo:250:kworker.0 10000000:01000000:2.0:1789123255.187204:0:13573:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789123255.187210:0:13573:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc917e6 00000020:00000080:2.0:1789123255.187213:0:13573:0:(genops.c:885:class_export_put()) final put ffff9f342044d800/dd41f4a0-f4e3-41a1-856e-0c34af912023 00000020:01000000:2.0:1789123255.187218:0:13573:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.130@tcp (flags='') 00000020:00000080:2.0:1789123255.187222:0:13573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789123255.187231:0:13573:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.130@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789123255.187234:0:13573:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9f3407c54ed8) has no exports 10000000:01000000:2.0:1789123255.187250:0:5838:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1789123255.187284:0:13573:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.206.130@tcp: client import never connected 00000100:00080000:2.0:1789123255.187287:0:13573:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789123255.187289:0:13573:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789123255.187291:0:13573:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789123255.187292:0:13573:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789123255.187322:0:13573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789123255.187325:0:13573:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.130@tcp (uuid dd41f4a0-f4e3-41a1-856e-0c34af912023) 00000020:01000000:2.0:1789123255.187328:0:13573:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789123255.187331:0:13573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789123255.187334:0:13573:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789123255.187339:0:13573:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9f33012b5800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789123255.187344:0:13573:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9f34066a8000) has exports, disconnecting them 00000020:00080000:2.0:1789123255.187348:0:13573:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9f33012b5800), last request at 1789123030 00000020:00000080:2.0:1789123255.187352:0:13573:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc91a1d 00000020:00080000:2.0:1789123255.187360:0:13573:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f33012b5800): rc 0 00000020:00000080:2.0:1789123255.187363:0:13573:0:(genops.c:885:class_export_put()) final put ffff9f33012b5800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789123255.189353:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f343592f000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789123255.189386:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f342044d800/dd41f4a0-f4e3-41a1-856e-0c34af912023 for MGC192.168.206.130@tcp 00000020:00000080:0.0:1789123255.189392:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f342044e000 for MGC192.168.206.130@tcp 00000020:00000080:0.0:1789123255.189401:0:8:0:(genops.c:885:class_export_put()) final put ffff9f3420448800/dd41f4a0-f4e3-41a1-856e-0c34af912023 00000020:00000080:0.0:1789123255.189403:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f3420448800/dd41f4a0-f4e3-41a1-856e-0c34af912023 for MGC192.168.206.130@tcp 00000020:01000000:0.0:1789123255.189407:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.130@tcp (dd41f4a0-f4e3-41a1-856e-0c34af912023) 00000020:00000080:0.0:1789123255.189876:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f33012b5800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789123255.190748:0:13573:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789123255.190754:0:13573:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789123255.190758:0:13573:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789123255.190764:0:13573:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789123255.191105:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f3441fb8000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1789123255.191122:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1789123255.191290:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1789123255.191518:0:13264:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1789123255.191772:0:5823:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9f34066cfa00:5823] 1 exiting: rc = 0 00000100:00100000:0.0:1789123255.194758:0:5822:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9f34066cee00:5822] 0 exiting: rc = 1 00000100:00100000:1.0:1789123255.194924:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.195211:0:5825:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9f3418241800:5825] 1 exiting: rc = 0 00000100:00100000:0.0:1789123255.198844:0:5826:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9f3418240c00:5826] 2 exiting: rc = 0 00000100:00100000:0.0:1789123255.198958:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9f3418241400:5824] 0 exiting: rc = 1 00000100:00100000:0.0:1789123255.204218:0:11614:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9f343bf57000:11614] 3 exiting: rc = 0 00000100:00100000:1.0:1789123255.204394:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204404:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204411:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204416:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204421:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204427:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204432:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204437:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204442:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204447:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204452:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204457:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204464:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204469:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204496:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204502:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204508:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204514:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204519:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204526:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204541:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204546:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204551:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204556:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204561:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204565:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204569:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204574:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204580:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204585:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204590:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204595:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204600:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204605:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204609:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204614:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204618:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204623:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204654:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204659:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204663:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204668:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204673:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204677:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204682:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204687:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204693:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204698:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204703:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204715:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204720:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204725:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204730:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204734:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204738:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204743:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204747:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204752:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204757:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204761:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204766:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204772:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204777:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.204782:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789123255.208150:0:13573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789123255.208165:0:13573:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789123255.208172:0:13573:0:(genops.c:885:class_export_put()) final put ffff9f3301314000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789123255.208178:0:13573:0:(genops.c:844:class_export_destroy()) destroying export ffff9f3301314000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789123255.208184:0:13573:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1789123255.208237:0:13573:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f3406274800 1 00000020:00000080:1.0:1789123255.208242:0:13573:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7e1648d68fc919c2 00000020:00000080:1.0:1789123255.208247:0:13573:0:(genops.c:885:class_export_put()) final put ffff9f33012b1800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1789123255.208262:0:13573:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1789123255.208274:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f33012b1800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789123255.208285:0:13573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789123255.208290:0:13573:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789123255.208294:0:13573:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9f343bd04ed8) has no exports 00000020:00000080:1.0:1789123255.231212:0:13573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789123255.231228:0:13573:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1789123255.231234:0:13573:0:(genops.c:885:class_export_put()) final put ffff9f3406271000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789123255.231238:0:13573:0:(genops.c:844:class_export_destroy()) destroying export ffff9f3406271000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1789123255.231246:0:13573:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1789123255.231486:0:13573:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9f3406270000 00000020:01000000:1.0:1789123255.231508:0:13573:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1789123255.231513:0:13573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789123255.231518:0:13573:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789123255.231522:0:13573:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9f3407beb490) has no exports 00000020:00000080:1.0:1789123255.231562:0:13573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789123255.231570:0:13573:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1789123255.231573:0:13573:0:(genops.c:885:class_export_put()) final put ffff9f343bd18800/OSS_uuid 00000020:00000080:1.0:1789123255.231575:0:13573:0:(genops.c:844:class_export_destroy()) destroying export ffff9f343bd18800/OSS_uuid for OSS 00000020:01000000:1.0:1789123255.231579:0:13573:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1789123255.234874:0:5836:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1789123255.235045:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9f3406262c00:6686] 0 exiting: rc = 1 00000100:00100000:2.0:1789123255.235100:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9f3406263600:6687] 1 exiting: rc = 0 00000100:00100000:2.0:1789123255.235146:0:8519:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9f342d82aa00:8519] 3 exiting: rc = 0 00000100:00100000:3.0:1789123255.237460:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9f3406262800:6688] 2 exiting: rc = 0 00000100:00100000:1.0:1789123255.239807:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.239827:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.239836:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.239843:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.239848:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.239855:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.239860:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.239865:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.239870:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.239874:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.239880:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.239885:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.239890:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.239894:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.239899:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.239904:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.239919:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.239925:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.239930:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.239936:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.239942:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.239947:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.239952:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.239957:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.239962:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.239983:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.239988:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.239993:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.239998:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240003:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240007:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240011:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240026:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240032:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240037:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240042:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240048:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240054:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240059:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240063:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240068:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240073:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240078:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240083:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240088:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240093:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240098:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240103:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240108:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240112:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240117:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240122:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240126:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240134:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240139:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240144:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240148:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240153:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240158:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240162:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240174:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240179:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240183:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.240188:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.243194:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9f3405c09400:6690] 1 exiting: rc = 0 00000100:00100000:1.0:1789123255.243858:0:12667:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9f3407cd2c00:12667] 2 exiting: rc = 0 00000100:00100000:3.0:1789123255.244296:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9f3406262600:6689] 0 exiting: rc = 1 00000100:00100000:0.0:1789123255.244882:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.244891:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.244920:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.244925:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.244929:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.244934:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.244938:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.244943:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.244947:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.244953:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.244958:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.244962:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.244967:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.244971:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.244976:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.244980:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.244984:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.244989:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.244994:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.244999:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245003:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245009:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245028:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245034:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245039:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245045:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245051:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245056:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245061:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245065:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245070:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245075:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245080:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245085:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245090:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245095:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245100:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245113:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245117:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245123:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245128:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245134:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245138:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245143:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245148:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245154:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245159:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245164:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245168:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245173:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245178:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245183:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245188:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245192:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245197:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245202:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245207:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245212:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245217:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245221:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245226:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245231:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245235:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.245241:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.247743:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9f3441cb9800:6693] 2 exiting: rc = 0 00000100:00100000:0.0:1789123255.249750:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9f3406771e00:6691] 0 exiting: rc = 1 00000100:00100000:0.0:1789123255.250181:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9f34067d8c00:6692] 1 exiting: rc = 0 00000100:00100000:1.0:1789123255.250309:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250317:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250323:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250329:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250334:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250339:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250345:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250350:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250356:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250361:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250366:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250384:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250389:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250394:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250398:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250403:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250419:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250426:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250431:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250437:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250442:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250448:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250453:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250458:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250464:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250469:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250474:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250480:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250485:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250507:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250513:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250519:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250525:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250540:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250546:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250552:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250558:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250564:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250571:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250577:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250597:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250604:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250609:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250614:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250619:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250624:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250653:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250659:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250665:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250670:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250675:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250680:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250685:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250689:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250694:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250699:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250706:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250712:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250717:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250723:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250728:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250732:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250737:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.250743:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789123255.257664:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9f3441cb8400:6694] 0 exiting: rc = 1 00000100:00100000:1.0:1789123255.258083:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9f3441cb9200:6695] 1 exiting: rc = 0 00000100:00100000:1.0:1789123255.258146:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258152:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258157:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258162:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258167:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258172:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258177:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258182:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258187:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258192:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258197:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258203:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258208:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258213:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258218:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258223:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258227:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258232:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258237:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258242:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258246:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258251:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258255:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258260:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258265:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258271:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258278:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258283:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258289:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258293:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258298:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258303:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258309:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258314:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258338:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258343:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258348:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258354:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258360:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258365:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258384:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258389:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258394:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258398:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258404:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258409:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258413:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258418:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258422:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258427:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258431:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258436:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258450:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258456:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258461:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258465:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258470:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258475:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258479:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258484:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258489:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258493:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258498:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.258503:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.260480:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9f34067d9400:6697] 1 exiting: rc = 0 00000100:00100000:0.0:1789123255.260722:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9f343bd49e00:6696] 0 exiting: rc = 1 00000100:00100000:1.0:1789123255.261027:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261035:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261048:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261055:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261077:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261083:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261089:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261095:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261100:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261106:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261112:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261118:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261123:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261128:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261134:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261154:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261161:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261168:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261174:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261180:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261185:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261192:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261198:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261205:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261214:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261219:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261225:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261244:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261251:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261257:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261262:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261268:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261274:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261280:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261286:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261291:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261297:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261303:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261309:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261333:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261339:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261345:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261352:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261358:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261364:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261807:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261814:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261821:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261827:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261832:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261838:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261860:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261867:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261874:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261880:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261885:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261891:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261897:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261903:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261919:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261926:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261932:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261937:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789123255.261951:0:13573:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1789123255.280305:0:13573:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1789123275.225016:0:14193:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789123283.992373:0:14653:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789123283.992379:0:14653:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1789123283.992483:0:14653:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f343fca3000 00000020:01000004:0.0:1789123283.992498:0:14653:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1789123283.992514:0:14653:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789123283.992526:0:14653:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9f342d8ab490) 00000020:00000080:0.0:1789123283.992538:0:14653:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789123284.029492:0:14653:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789123284.039515:0:14653:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1789123284.040047:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:0.0:1789123284.040138:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:0.0:1789123284.040313:0:14653:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1789123284.040372:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:0.0:1789123284.040576:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:0.0:1789123284.040789:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:0.0:1789123284.040944:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:0.0:1789123284.041201:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:2.0:1789123284.043370:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 467: rc = 0 00100000:10000000:2.0:1789123284.043595:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 467: rc = 0 00100000:10000000:2.0:1789123284.044215:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 533: rc = 0 00100000:10000000:2.0:1789123284.044588:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 533: rc = 0 00100000:10000000:2.0:1789123284.045067:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 533: rc = 0 00100000:10000000:2.0:1789123284.045307:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 533: rc = 0 00100000:10000000:2.0:1789123284.045829:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 533: rc = 0 00100000:10000000:2.0:1789123284.046093:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 533: rc = 0 00100000:10000000:2.0:1789123284.046348:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 533: rc = 0 00100000:10000000:2.0:1789123284.047137:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 533: rc = 0 00100000:10000000:2.0:1789123284.047391:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 533: rc = 0 00100000:10000000:2.0:1789123284.047853:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 533: rc = 0 00100000:10000000:2.0:1789123284.048117:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 533: rc = 0 00100000:10000000:2.0:1789123284.048360:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 533: rc = 0 00100000:10000000:2.0:1789123284.049112:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 487: rc = 0 00100000:10000000:2.0:1789123284.049328:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 487: rc = 0 00100000:10000000:2.0:1789123284.049940:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 487: rc = 0 00100000:10000000:2.0:1789123284.050156:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 487: rc = 0 00100000:10000000:2.0:1789123284.050360:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 487: rc = 0 00100000:10000000:2.0:1789123284.051908:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 487: rc = 0 00100000:10000000:2.0:1789123284.052180:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 487: rc = 0 00100000:10000000:2.0:1789123284.053488:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 487: rc = 0 00100000:10000000:2.0:1789123284.053922:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 487: rc = 0 00100000:10000000:2.0:1789123284.054164:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 487: rc = 0 00100000:10000000:2.0:1789123284.054566:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 487: rc = 0 00100000:10000000:2.0:1789123284.054935:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 487: rc = 0 00100000:10000000:2.0:1789123284.055155:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 487: rc = 0 00100000:10000000:2.0:1789123284.055371:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 487: rc = 0 00100000:10000000:2.0:1789123284.056050:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 487: rc = 0 00100000:10000000:2.0:1789123284.056270:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 487: rc = 0 00100000:10000000:2.0:1789123284.056594:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 487: rc = 0 00100000:10000000:2.0:1789123284.056969:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 487: rc = 0 00100000:10000000:2.0:1789123284.057186:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 487: rc = 0 00100000:10000000:2.0:1789123284.057517:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 487: rc = 0 00100000:10000000:2.0:1789123284.057880:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 487: rc = 0 00100000:10000000:2.0:1789123284.058108:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 487: rc = 0 00100000:10000000:2.0:1789123284.058347:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 487: rc = 0 00100000:10000000:2.0:1789123284.058870:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 487: rc = 0 00100000:10000000:2.0:1789123284.059286:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 487: rc = 0 00100000:10000000:2.0:1789123284.060141:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 487: rc = 0 00100000:10000000:2.0:1789123284.060455:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 487: rc = 0 00100000:10000000:2.0:1789123284.060969:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 487: rc = 0 00100000:10000000:2.0:1789123284.061228:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 487: rc = 0 00100000:10000000:2.0:1789123284.061872:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 487: rc = 0 00100000:10000000:2.0:1789123284.062131:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 487: rc = 0 00100000:10000000:2.0:1789123284.062376:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 487: rc = 0 00100000:10000000:2.0:1789123284.063763:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 476: rc = 0 00100000:10000000:2.0:1789123284.064489:0:14653:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1789123284.064686:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 472: rc = 0 00100000:10000000:2.0:1789123284.065030:0:14653:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1789123284.065107:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 472: rc = 0 00100000:10000000:2.0:1789123284.065322:0:14653:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1789123284.065384:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 472: rc = 0 00100000:10000000:2.0:1789123284.065910:0:14653:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1789123284.065967:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 468: rc = 0 00100000:10000000:2.0:1789123284.066141:0:14653:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1789123284.066196:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 468: rc = 0 00100000:10000000:2.0:1789123284.066361:0:14653:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1789123284.066547:0:14653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 468: rc = 0 00000020:00000080:2.0:1789123284.066902:0:14653:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789123284.066909:0:14653:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789123284.066917:0:14653:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7e1648d68fc92b26 00000020:01000004:2.0:1789123284.066924:0:14653:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789123284.066929:0:14653:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789123284.066933:0:14653:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f343fca3000 from MGS 00000020:01000004:2.0:1789123284.066936:0:14653:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789123284.066946:0:14653:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9f34066a9a48) 00000020:00000080:2.0:1789123284.066953:0:14653:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789123284.067001:0:14653:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f343fca3000 from MGS, refs=2 00080000:01000000:2.0:1789123284.067005:0:14653:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789123284.067009:0:14653:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7e1648d68fc92b34 00000100:00100000:2.0:1789123284.067091:0:14653:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789123284.067217:0:14653:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789123284.067223:0:14653:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789123284.067906:0:14653:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789123284.067914:0:14653:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789123284.073818:0:14653:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789123284.074011:0:14653:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789123284.074017:0:14653:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789123284.074749:0:14653:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789123284.074757:0:14653:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789123284.075005:0:14653:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789123284.075010:0:14653:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789123284.078316:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123284.078322:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123284.078324:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123284.079208:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123284.079212:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123284.079214:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123284.080239:0:14653:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789123284.085234:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789123284.101824:0:14653:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789123284.101844:0:14653:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789123284.101847:0:14653:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1789123284.106377:0:14662:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789123284.106605:0:14653:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789123284.106752:0:14653:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789123284.107260:0:14653:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789123284.107548:0:14653:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789123284.107784:0:14653:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789123284.107789:0:14653:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789123284.115165:0:14653:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789123284.115178:0:14653:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789123284.115597:0:14653:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789123284.115604:0:14653:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789123284.116378:0:14653:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789123284.116399:0:14653:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.130@tcp' 00000020:01000004:2.0:1789123284.116401:0:14653:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789123284.116429:0:14653:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.130@tcp (typ=mgc) 00000020:00000080:2.0:1789123284.116441:0:14653:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.130@tcp (ffff9f34066aced8) 00000020:00000080:2.0:1789123284.116456:0:14653:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789123284.116534:0:14653:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f33012b4800@MGC192.168.206.130@tcp: add connection 192.168.206.130@tcp at head 00010000:00010000:2.0:1789123284.116879:0:14653:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.130@tcp-0 is initialized 00000040:01000000:2.0:1789123284.116886:0:14653:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.130@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789123284.117227:0:14667:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1789123284.121225:0:14668:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789123284.121360:0:14653:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.130@tcp (uuid 39ef4522-e133-4b32-b80c-ca92d5b19344) 00000020:00000080:3.0:1789123284.121384:0:14653:0:(genops.c:1385:class_connect()) connect: client 39ef4522-e133-4b32-b80c-ca92d5b19344, cookie 0x7e1648d68fc92b42 00000100:00080000:3.0:1789123284.121397:0:14653:0:(import.c:510:import_select_connection()) MGC192.168.206.130@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789123284.121403:0:14653:0:(import.c:624:import_select_connection()) MGC192.168.206.130@tcp: import ffff9f33012b4800 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:3.0:1789123284.121441:0:14653:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f34062cbc00 x1876031381266432/t0(0) o250->MGC192.168.206.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789123284.121472:0:14653:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 39ef4522-e133-4b32-b80c-ca92d5b19344->MGS 00000020:01000004:3.0:1789123284.121497:0:14653:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789123284.121502:0:14653:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789123284.121515:0:14653:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9f343bd01a48) 00000020:00000080:3.0:1789123284.121577:0:14653:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789123284.124457:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:39ef4522-e133-4b32-b80c-ca92d5b19344:3301:1876031381266432:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789123284.124552:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123284.124656:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381266432 00000100:00100000:0.0:1789123284.124664:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381266432 00000100:00100000:0.0:1789123284.124696:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789123284.124704:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427b23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3301:x1876031381266432:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789123284.124732:0:14663:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 39ef4522-e133-4b32-b80c-ca92d5b19344@0@lo t0 exp 0000000000000000 cur 398 last 0 00000020:00000080:0.0:1789123284.124771:0:14663:0:(genops.c:1385:class_connect()) connect: client 39ef4522-e133-4b32-b80c-ca92d5b19344, cookie 0x7e1648d68fc92b50 00000100:00080000:0.0:1789123284.124929:0:14663:0:(import.c:65:import_set_state_nolock()) ffff9f343fca3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789123284.124985:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427b23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+5:3301:x1876031381266432:12345-0@lo:250:mount.lustre.0 Request processed in 280us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123284.124993:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789123284.125044:0:3301:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.130@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789123284.125055:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.130@tcp: connect to target with instance 0 00000100:00080000:0.0:1789123284.125124:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789123284.125129:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789123284.125132:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9f33012b4800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789123284.125135:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789123284.125144:0:3301:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789123284.125149:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:39ef4522-e133-4b32-b80c-ca92d5b19344:3301:1876031381266432:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789123284.137396:0:14653:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789123284.137601:0:14653:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789123284.137607:0:14653:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789123284.141788:0:14653:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789123284.141810:0:14653:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789123284.142291:0:14653:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789123284.142299:0:14653:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789123284.143055:0:14653:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789123284.143225:0:14653:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789123284.143229:0:14653:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789123284.144200:0:14653:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789123284.144208:0:14653:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789123284.186979:0:14653:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789123284.187168:0:14653:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789123284.187174:0:14653:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789123284.188736:0:14653:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789123284.188756:0:14653:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789123284.189296:0:14653:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789123284.189538:0:14653:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789123284.189543:0:14653:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789123284.190114:0:14653:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789123284.190121:0:14653:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789123284.190887:0:14653:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789123284.191041:0:14653:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789123284.191046:0:14653:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789123284.191660:0:14653:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789123284.191667:0:14653:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789123284.192479:0:14653:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789123284.192899:0:14653:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789123284.192905:0:14653:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789123284.193477:0:14653:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789123284.193486:0:14653:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789123284.225002:0:14653:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789123284.225347:0:14653:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789123284.225354:0:14653:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789123284.235434:0:14653:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789123284.235449:0:14653:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789123284.237809:0:14653:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789123284.237824:0:14653:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789123284.248807:0:14653:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789123284.248840:0:14653:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1789123284.248846:0:14653:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789123284.248988:0:14653:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.130@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789123284.249021:0:14653:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.130@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789123284.249025:0:14653:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789123284.249026:0:14653:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789123284.249028:0:14653:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789123284.249029:0:14653:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789123284.249030:0:14653:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789123284.249031:0:14653:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789123284.249033:0:14653:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789123284.249034:0:14653:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789123284.249035:0:14653:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789123284.249036:0:14653:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789123284.249039:0:14653:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789123284.249041:0:14653:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789123284.249042:0:14653:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789123284.249043:0:14653:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789123284.249044:0:14653:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789123284.249045:0:14653:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789123284.249046:0:14653:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789123284.249047:0:14653:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789123284.249048:0:14653:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789123284.249049:0:14653:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789123284.249050:0:14653:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789123284.249075:0:14653:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789123284.249093:0:14653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381266560:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789123284.249163:0:14653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123284.249232:0:14653:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410b80a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789123284.249320:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381266560 00000100:00100000:2.0:1789123284.249327:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381266560 00000100:00100000:2.0:1789123284.249368:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789123284.249377:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427b23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+5:14653:x1876031381266560:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789123284.249435:0:14666:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789123284.249438:0:14666:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789123284.249441:0:14666:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1789123284.251257:0:14686:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789123284.251706:0:14666:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1789123284.254074:0:14687:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1789123284.254083:0:14687:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1789123284.254085:0:14687:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1789123284.254115:0:14687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1789123284.254460:0:14666:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789123284.254472:0:14666:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789123284.267982:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427b23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+5:14653:x1876031381266560:12345-0@lo:253:mount.lustre.0 Request processed in 18598us (18810us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123284.267997:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789123284.268108:0:14653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381266560:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789123284.268141:0:14653:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789123284.268144:0:14653:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789123284.268146:0:14653:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789123284.268147:0:14653:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789123284.268148:0:14653:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789123284.268150:0:14653:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789123284.268151:0:14653:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789123284.268152:0:14653:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789123284.268154:0:14653:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789123284.268156:0:14653:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789123284.268158:0:14653:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789123284.268178:0:14653:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f343fca3000 from lustre-MDT0000 10000000:01000000:1.0:1789123284.268220:0:14653:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789123284.268223:0:14653:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789123284.268228:0:14653:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9f34066aced8 10000000:01000000:1.0:1789123284.268232:0:14653:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789123284.268240:0:14653:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f34066aced8 from 1 10000000:01000000:1.0:1789123284.268244:0:14653:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789123284.268284:0:14653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd32600/0x7e1648d68fc92b57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123284.268295:0:14653:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f343bd32600/0x7e1648d68fc92b57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123284.268305:0:14653:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f343bd32600/0x7e1648d68fc92b57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123284.268327:0:14653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381266688:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789123284.268366:0:14653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123284.268416:0:14653:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408e2f480 going to sleep for 11 seconds 00000100:00100000:0.0:1789123284.268580:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381266688 00000100:00100000:0.0:1789123284.268586:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381266688 00000100:00100000:0.0:1789123284.268672:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789123284.268682:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427b20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+5:14653:x1876031381266688:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789123284.268696:0:14665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123284.268717:0:14665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3435b52000/0x7e1648d68fc92b5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc92b57 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123284.268851:0:14665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3435b52000/0x7e1648d68fc92b5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc92b57 expref: 6 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123284.268875:0:14665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3435b52000/0x7e1648d68fc92b5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc92b57 expref: 6 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123284.268885:0:14665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b52000, rc 0) 00000100:00100000:0.0:1789123284.268919:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427b20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+6:14653:x1876031381266688:12345-0@lo:101:mount.lustre.0 Request processed in 239us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123284.268926:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789123284.269484:0:14653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381266688:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789123284.269503:0:14653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f343bd32600/0x7e1648d68fc92b57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92b5e expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123284.269521:0:14653:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f343bd32600/0x7e1648d68fc92b57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc92b5e expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123284.269583:0:14653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381266816:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789123284.269618:0:14653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123284.269811:0:14653:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408e2f480 going to sleep for 11 seconds 00000100:00100000:0.0:1789123284.270845:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381266816 00000100:00100000:0.0:1789123284.270855:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381266816 00000100:00100000:0.0:1789123284.270911:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789123284.270920:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427b22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+6:14653:x1876031381266816:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789123284.271173:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427b22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+6:14653:x1876031381266816:12345-0@lo:501:mount.lustre.0 Request processed in 253us (1553us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789123284.271181:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789123284.272941:0:14653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381266816:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789123284.272986:0:14653:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789123284.273009:0:14653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd32600/0x7e1648d68fc92b57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92b5e expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123284.273020:0:14653:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f343bd32600/0x7e1648d68fc92b57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92b5e expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789123284.273029:0:14653:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f343fca3000 10000000:01000000:1.0:1789123284.273034:0:14653:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789123284.273039:0:14653:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9f343fca3000 10000000:01000000:1.0:1789123284.273042:0:14653:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789123284.273045:0:14653:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9f343fca3000 from 1 10000000:01000000:1.0:1789123284.273048:0:14653:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789123284.273078:0:14653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd33800/0x7e1648d68fc92b65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123284.273086:0:14653:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f343bd33800/0x7e1648d68fc92b65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123284.273096:0:14653:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f343bd33800/0x7e1648d68fc92b65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123284.273126:0:14653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381266944:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789123284.273174:0:14653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123284.273228:0:14653:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408e2f480 going to sleep for 11 seconds 00000100:00100000:2.0:1789123284.273565:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381266944 00000100:00100000:2.0:1789123284.273573:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381266944 00000100:00100000:2.0:1789123284.273622:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789123284.273648:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427b23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+6:14653:x1876031381266944:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789123284.273667:0:14665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123284.273687:0:14665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f342d80be00/0x7e1648d68fc92b6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc92b65 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123284.273722:0:14665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f342d80be00/0x7e1648d68fc92b6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc92b65 expref: 7 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123284.273732:0:14665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f342d80be00/0x7e1648d68fc92b6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc92b65 expref: 7 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123284.273740:0:14665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80be00, rc 0) 00000100:00100000:2.0:1789123284.273788:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427b23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+7:14653:x1876031381266944:12345-0@lo:101:mount.lustre.0 Request processed in 143us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123284.273796:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789123284.273906:0:14653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381266944:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789123284.273921:0:14653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f343bd33800/0x7e1648d68fc92b65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92b6c expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123284.273930:0:14653:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f343bd33800/0x7e1648d68fc92b65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc92b6c expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789123284.273941:0:14653:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789123284.273949:0:14653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd33800/0x7e1648d68fc92b65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92b6c expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123284.273955:0:14653:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f343bd33800/0x7e1648d68fc92b65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92b6c expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789123284.273960:0:14653:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789123284.273964:0:14653:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789123284.273969:0:14653:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9f343fca3000 10000000:01000000:1.0:1789123284.273971:0:14653:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789123284.273974:0:14653:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789123284.273976:0:14653:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789123284.273995:0:14653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd33e00/0x7e1648d68fc92b73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123284.274003:0:14653:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f343bd33e00/0x7e1648d68fc92b73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123284.274018:0:14653:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f343bd33e00/0x7e1648d68fc92b73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123284.274033:0:14653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381267072:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789123284.274060:0:14653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123284.274089:0:14653:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408e2f480 going to sleep for 11 seconds 00000100:00100000:0.0:1789123284.274260:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381267072 00000100:00100000:0.0:1789123284.274265:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381267072 00000100:00100000:0.0:1789123284.274297:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789123284.274305:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427b21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+7:14653:x1876031381267072:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789123284.274312:0:14666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123284.274322:0:14666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3435b53800/0x7e1648d68fc92b7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc92b73 expref: -99 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123284.274336:0:14666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3435b53800/0x7e1648d68fc92b7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc92b73 expref: 8 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123284.274352:0:14666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3435b53800/0x7e1648d68fc92b7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc92b73 expref: 8 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123284.274359:0:14666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53800, rc 0) 00000100:00100000:0.0:1789123284.274399:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427b21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+8:14653:x1876031381267072:12345-0@lo:101:mount.lustre.0 Request processed in 95us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123284.274405:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789123284.274481:0:14653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381267072:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789123284.274492:0:14653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f343bd33e00/0x7e1648d68fc92b73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92b7a expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123284.274500:0:14653:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f343bd33e00/0x7e1648d68fc92b73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc92b7a expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123284.274542:0:14653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381267200:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789123284.274569:0:14653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123284.274591:0:14653:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408e2f480 going to sleep for 11 seconds 00000100:00100000:0.0:1789123284.274620:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381267200 00000100:00100000:0.0:1789123284.274653:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381267200 00000100:00100000:0.0:1789123284.274679:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789123284.274686:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427b22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+8:14653:x1876031381267200:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789123284.276909:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427b22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+9:14653:x1876031381267200:12345-0@lo:501:mount.lustre.0 Request processed in 2217us (2332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123284.276924:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789123284.276998:0:14653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381267200:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789123284.277066:0:14653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062c9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381267328:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789123284.277111:0:14653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123284.277191:0:14653:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f343c34fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789123284.277387:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381267328 00000100:00100000:2.0:1789123284.277460:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381267328 00000100:00100000:2.0:1789123284.277509:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789123284.277519:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427b23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+9:14653:x1876031381267328:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789123284.278142:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427b23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+9:14653:x1876031381267328:12345-0@lo:503:mount.lustre.0 Request processed in 622us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123284.278150:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789123284.278900:0:14653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062c9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381267328:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789123284.279713:0:14688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062c9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39ef4522-e133-4b32-b80c-ca92d5b19344:14688:1876031381267456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789123284.279947:0:14688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123284.279982:0:14688:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f343c34f180 going to sleep for 11 seconds 00000100:00100000:1.0:1789123284.280145:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381267456 00000100:00100000:1.0:1789123284.280152:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381267456 00000100:00100000:1.0:1789123284.280189:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789123284.280299:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427b21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+9:14688:x1876031381267456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789123284.280683:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427b21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+9:14688:x1876031381267456:12345-0@lo:502:llog_process_th.0 Request processed in 484us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123284.280691:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789123284.281093:0:14688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062c9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39ef4522-e133-4b32-b80c-ca92d5b19344:14688:1876031381267456:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789123284.281123:0:14688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789123284.281134:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789123284.281136:0:14688:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789123284.281141:0:14688:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789123284.281149:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789123284.281163:0:14688:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9f34066a8000) 00000020:00000080:2.0:1789123284.281179:0:14688:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789123284.281185:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789123284.281348:0:14688:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789123284.281355:0:14688:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7e1648d68fc92b88 00000020:00000080:2.0:1789123284.281912:0:14688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789123284.281918:0:14688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789123284.281922:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789123284.281923:0:14688:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789123284.281926:0:14688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789123284.281929:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789123284.281931:0:14688:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789123284.281933:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789123284.281942:0:14688:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9f34066ab490) 00000020:00000080:2.0:1789123284.281951:0:14688:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789123284.281955:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789123284.281957:0:14688:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789123284.281959:0:14688:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789123284.281964:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789123284.282013:0:14688:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f343fca3000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789123284.282032:0:14688:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9f3441ea0000) 00000020:00000080:2.0:1789123284.282040:0:14688:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789123284.282084:0:14688:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789123284.282089:0:14688:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7e1648d68fc92b9d 00000020:00000080:2.0:1789123284.282187:0:14688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789123284.282193:0:14688:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789123284.282494:0:14688:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x7e1648d68fc92ba4 00080000:01000000:2.0:1789123284.282501:0:14688:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789123284.282504:0:14688:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7e1648d68fc92bab 00010000:00010000:2.0:1789123284.380219:0:14688:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789123284.380772:0:14688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1789123284.380951:0:14688:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789123284.381691:0:14688:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9f3441ea1a48) 00000020:00000080:2.0:1789123284.381709:0:14688:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789123284.381770:0:14688:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789123284.381776:0:14688:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7e1648d68fc92bb9 00000020:00000080:1.0:1789123284.386186:0:14688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789123284.405475:0:14688:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x7e1648d68fc92bc0 00000020:00000080:1.0:1789123284.406261:0:14688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789123284.406274:0:14688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789123284.406281:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789123284.406283:0:14688:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789123284.406287:0:14688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789123284.406290:0:14688:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1789123284.406292:0:14688:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789123284.406293:0:14688:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789123284.406295:0:14688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789123284.406298:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789123284.406300:0:14688:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789123284.406302:0:14688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789123284.406307:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789123284.406309:0:14688:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789123284.406314:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789123284.406345:0:14688:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789123284.406362:0:14688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789123284.406366:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789123284.406367:0:14688:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789123284.406370:0:14688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789123284.406373:0:14688:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789123284.406376:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789123284.406377:0:14688:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789123284.406380:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789123284.406384:0:14688:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.130@tcp to nid 0x20000c0a8ce82 (192.168.206.130@tcp) 00000020:01000000:1.0:1789123284.406408:0:14688:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789123284.406412:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789123284.406425:0:14688:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9f3436569a48) 00000020:00000080:1.0:1789123284.406438:0:14688:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789123284.406443:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789123284.406504:0:14688:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789123284.406514:0:14688:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789123284.406521:0:14688:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7e1648d68fc92bce 00010000:00080000:1.0:1789123284.406551:0:14688:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f33012b6000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.130@tcp at head 00010000:00010000:0.0:1789123284.412068:0:14688:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1789123284.412469:0:14688:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789123284.412517:0:14688:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789123284.420033:0:14688:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789123284.420126:0:14688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1789123284.420230:0:14688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1789123284.427706:0:14692:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789123284.427715:0:14692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789123284.434197:0:14688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789123284.434210:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789123284.434241:0:14688:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789123284.434258:0:14688:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7e1648d68fc92bd5 00000100:00080000:3.0:1789123284.434267:0:14688:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789123284.434272:0:14688:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f33012b6000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:3.0:1789123284.434306:0:14688:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f34062c8780 x1876031381267584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789123284.434334:0:14688:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789123284.434388:0:14688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789123284.434402:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123284.434404:0:14688:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789123284.434408:0:14688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789123284.434410:0:14688:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789123284.434412:0:14688:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789123284.434414:0:14688:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789123284.434415:0:14688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789123284.434417:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123284.434419:0:14688:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789123284.434421:0:14688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789123284.434425:0:14688:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789123284.434428:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123284.434429:0:14688:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789123284.434433:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789123284.434436:0:14688:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.130@tcp to nid 0x20000c0a8ce82 (192.168.206.130@tcp) 00000020:01000000:3.0:1789123284.434458:0:14688:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789123284.434461:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789123284.434471:0:14688:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9f343bd00000) 00000020:00000080:3.0:1789123284.434482:0:14688:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1789123284.434486:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789123284.434533:0:14688:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789123284.434538:0:14688:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789123284.434542:0:14688:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7e1648d68fc92be3 00010000:00080000:3.0:1789123284.434567:0:14688:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f343b0d7000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.130@tcp at head 00000100:00100000:0.0:1789123284.436104:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062c8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876031381267584:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789123284.436180:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876031381267584 offset 0 length 520: 4 00010000:00010000:2.0:1789123284.437575:0:14688:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1789123284.437809:0:14688:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789123284.437832:0:14688:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789123284.438548:0:14688:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789123284.438614:0:14688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789123284.438699:0:14688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1789123284.440493:0:14694:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789123284.440500:0:14694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789123284.444809:0:14688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789123284.444824:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789123284.444888:0:14688:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789123284.444909:0:14688:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7e1648d68fc92bea 00000100:00080000:2.0:1789123284.444918:0:14688:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789123284.444923:0:14688:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f343b0d7000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:2.0:1789123284.444954:0:14688:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f343c30a580 x1876031381267712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789123284.444972:0:14688:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789123284.445576:0:14688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789123284.445590:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789123284.445592:0:14688:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789123284.445597:0:14688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789123284.445601:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789123284.445602:0:14688:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789123284.445605:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789123284.445607:0:14688:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789123284.445609:0:14688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789123284.445611:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789123284.445613:0:14688:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789123284.445615:0:14688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789123284.445820:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789123284.445822:0:14688:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789123284.445828:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789123284.445872:0:14688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c309680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39ef4522-e133-4b32-b80c-ca92d5b19344:14688:1876031381267840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789123284.445948:0:14688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123284.445994:0:14688:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f343567e900 going to sleep for 11 seconds 00000100:00100000:3.0:1789123284.446070:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381267840 00000100:00100000:3.0:1789123284.446077:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381267840 00000100:00100000:3.0:1789123284.446121:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789123284.446130:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427b21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+9:14688:x1876031381267840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789123284.446362:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427b21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+9:14688:x1876031381267840:12345-0@lo:502:llog_process_th.0 Request processed in 233us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123284.446370:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789123284.446519:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c30a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876031381267712:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789123284.446549:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876031381267712 offset 0 length 520: 4 00000100:00100000:2.0:1789123284.447201:0:14688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c309680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39ef4522-e133-4b32-b80c-ca92d5b19344:14688:1876031381267840:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789123284.447237:0:14688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789123284.447243:0:14688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789123284.447245:0:14688:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789123284.447249:0:14688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1789123284.447527:0:14653:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1789123284.447546:0:14653:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789123284.447565:0:14653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd33e00/0x7e1648d68fc92b73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92b7a expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123284.447576:0:14653:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f343bd33e00/0x7e1648d68fc92b73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92b7a expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789123284.447592:0:14653:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f343fca3000 from 1 10000000:01000000:1.0:1789123284.447596:0:14653:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789123284.448129:0:14653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd33200/0x7e1648d68fc92bf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123284.448141:0:14653:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f343bd33200/0x7e1648d68fc92bf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123284.448151:0:14653:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f343bd33200/0x7e1648d68fc92bf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123284.448170:0:14653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035a9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381267968:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789123284.448219:0:14653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123284.448260:0:14653:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3418b9be40 going to sleep for 11 seconds 00000100:00100000:2.0:1789123284.448317:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381267968 00000100:00100000:2.0:1789123284.448323:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381267968 00000100:00100000:2.0:1789123284.448371:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789123284.448381:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427b22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+9:14653:x1876031381267968:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789123284.448394:0:14663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123284.448409:0:14663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f342d80a800/0x7e1648d68fc92bf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc92bf1 expref: -99 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123284.448430:0:14663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f342d80a800/0x7e1648d68fc92bf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc92bf1 expref: 10 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123284.448440:0:14663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f342d80a800/0x7e1648d68fc92bf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc92bf1 expref: 10 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123284.448449:0:14663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80a800, rc 0) 00000100:00100000:2.0:1789123284.448495:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427b22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+10:14653:x1876031381267968:12345-0@lo:101:mount.lustre.0 Request processed in 116us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123284.448502:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789123284.448602:0:14653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035a9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381267968:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789123284.448615:0:14653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f343bd33200/0x7e1648d68fc92bf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92bf8 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123284.448871:0:14653:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f343bd33200/0x7e1648d68fc92bf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc92bf8 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123284.449462:0:14653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035a9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381268096:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789123284.449508:0:14653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123284.449622:0:14653:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3418b9be40 going to sleep for 11 seconds 00000100:00100000:2.0:1789123284.451599:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381268096 00000100:00100000:2.0:1789123284.451612:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381268096 00000100:00100000:2.0:1789123284.451813:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789123284.451825:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427b20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+10:14653:x1876031381268096:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789123284.451851:0:14666:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789123284.451866:0:14666:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789123284.452263:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427b20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+10:14653:x1876031381268096:12345-0@lo:256:mount.lustre.0 Request processed in 439us (2753us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123284.452272:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789123284.452583:0:14653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035a9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381268096:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789123284.453374:0:14653:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789123284.453394:0:14653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd33200/0x7e1648d68fc92bf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92bf8 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123284.453421:0:14653:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f343bd33200/0x7e1648d68fc92bf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92bf8 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789123284.453429:0:14653:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f343fca3000 from 1 10000000:01000000:0.0:1789123284.453432:0:14653:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789123284.453469:0:14653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3435b53e00/0x7e1648d68fc92bff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123284.453476:0:14653:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f3435b53e00/0x7e1648d68fc92bff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123284.453486:0:14653:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f3435b53e00/0x7e1648d68fc92bff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123284.453506:0:14653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381268224:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789123284.453551:0:14653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123284.453787:0:14653:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3405f6aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789123284.456878:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381268224 00000100:00100000:1.0:1789123284.456891:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381268224 00000100:00100000:1.0:1789123284.456952:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789123284.456963:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427b22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+10:14653:x1876031381268224:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789123284.456977:0:14663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123284.456998:0:14663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f343bd33000/0x7e1648d68fc92c06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc92bff expref: -99 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123284.457024:0:14663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f343bd33000/0x7e1648d68fc92c06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc92bff expref: 11 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123284.457046:0:14663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f343bd33000/0x7e1648d68fc92c06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc92bff expref: 11 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123284.457055:0:14663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f343bd33000, rc 0) 00000100:00100000:1.0:1789123284.457125:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427b22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+11:14653:x1876031381268224:12345-0@lo:101:mount.lustre.0 Request processed in 164us (3573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123284.457132:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789123284.457413:0:14653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381268224:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789123284.457433:0:14653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f3435b53e00/0x7e1648d68fc92bff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92c06 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123284.457443:0:14653:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f3435b53e00/0x7e1648d68fc92bff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc92c06 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123284.457514:0:14653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381268352:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789123284.457549:0:14653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123284.457586:0:14653:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3405f6aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789123284.457844:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381268352 00000100:00100000:3.0:1789123284.457850:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381268352 00000100:00100000:3.0:1789123284.457895:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789123284.457904:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427b21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+11:14653:x1876031381268352:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789123284.458282:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427b21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+11:14653:x1876031381268352:12345-0@lo:501:mount.lustre.0 Request processed in 378us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123284.458289:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789123284.458528:0:14653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381268352:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789123284.458569:0:14653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381268480:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789123284.458613:0:14653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123284.458785:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381268480 00000100:00100000:2.0:1789123284.458791:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381268480 00000100:00100000:2.0:1789123284.458823:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789123284.458830:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343b0f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+11:14653:x1876031381268480:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789123284.459507:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343b0f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+11:14653:x1876031381268480:12345-0@lo:503:mount.lustre.0 Request processed in 675us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123284.459515:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789123284.459585:0:14653:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3405f6aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789123284.459600:0:14653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381268480:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789123284.460453:0:14696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39ef4522-e133-4b32-b80c-ca92d5b19344:14696:1876031381268608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789123284.460506:0:14696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123284.460541:0:14696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3405f6aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789123284.460597:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381268608 00000100:00100000:1.0:1789123284.460604:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381268608 00000100:00100000:1.0:1789123284.460682:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789123284.460698:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343b0f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+11:14696:x1876031381268608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789123284.460936:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343b0f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+11:14696:x1876031381268608:12345-0@lo:502:llog_process_th.0 Request processed in 238us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123284.460944:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789123284.461291:0:14696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39ef4522-e133-4b32-b80c-ca92d5b19344:14696:1876031381268608:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789123284.461322:0:14696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789123284.461332:0:14696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789123284.461334:0:14696:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789123284.461341:0:14696:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f343fca3000 00000020:00000080:0.0:1789123284.461343:0:14696:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789123284.461351:0:14696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789123284.461353:0:14696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789123284.461354:0:14696:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789123284.461356:0:14696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789123284.461358:0:14696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789123284.461359:0:14696:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789123284.461362:0:14696:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f343fca3000 00000020:00000080:0.0:1789123284.461364:0:14696:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789123284.461428:0:14696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789123284.461432:0:14696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789123284.461433:0:14696:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789123284.461435:0:14696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789123284.461438:0:14696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789123284.461439:0:14696:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789123284.461442:0:14696:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f343fca3000 00000020:00000080:0.0:1789123284.461449:0:14696:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789123284.461469:0:14696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789123284.461472:0:14696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789123284.461473:0:14696:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789123284.461475:0:14696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789123284.461478:0:14696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789123284.461479:0:14696:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789123284.461481:0:14696:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f343fca3000 00000020:00000080:0.0:1789123284.461483:0:14696:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789123284.461522:0:14696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39ef4522-e133-4b32-b80c-ca92d5b19344:14696:1876031381268736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789123284.461562:0:14696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123284.461595:0:14696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f33012449c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123284.463822:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381268736 00000100:00100000:1.0:1789123284.463835:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381268736 00000100:00100000:1.0:1789123284.463907:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789123284.463918:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343b0f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+11:14696:x1876031381268736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789123284.464196:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343b0f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+11:14696:x1876031381268736:12345-0@lo:502:llog_process_th.0 Request processed in 279us (2632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123284.464210:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789123284.464801:0:14696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39ef4522-e133-4b32-b80c-ca92d5b19344:14696:1876031381268736:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789123284.464833:0:14696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789123284.464840:0:14696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789123284.464842:0:14696:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789123284.464846:0:14696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789123284.465008:0:14653:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789123284.465027:0:14653:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789123284.465057:0:14653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3435b53e00/0x7e1648d68fc92bff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92c06 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123284.465068:0:14653:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f3435b53e00/0x7e1648d68fc92bff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92c06 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789123284.465112:0:14653:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789123284.465115:0:14653:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f343fca3000 10000000:01000000:1.0:1789123284.465118:0:14653:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f343fca3000 10000000:01000000:1.0:1789123284.465121:0:14653:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789123284.465127:0:14653:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f343fca3000 from 1 10000000:01000000:1.0:1789123284.465129:0:14653:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789123284.465157:0:14653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd32400/0x7e1648d68fc92c0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123284.465165:0:14653:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f343bd32400/0x7e1648d68fc92c0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123284.465181:0:14653:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f343bd32400/0x7e1648d68fc92c0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123284.465201:0:14653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035a8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381268864:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789123284.465245:0:14653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123284.471427:0:14653:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3418b9b240 going to sleep for 11 seconds 00000100:00100000:3.0:1789123284.472092:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381268864 00000100:00100000:3.0:1789123284.472102:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381268864 00000100:00100000:3.0:1789123284.472162:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789123284.472173:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343b0f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+11:14653:x1876031381268864:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789123284.472192:0:14665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123284.472212:0:14665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3402fbac00/0x7e1648d68fc92c14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc92c0d expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123284.472241:0:14665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3402fbac00/0x7e1648d68fc92c14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc92c0d expref: 12 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123284.472253:0:14665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3402fbac00/0x7e1648d68fc92c14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc92c0d expref: 12 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123284.472262:0:14665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbac00, rc 0) 00000100:00100000:3.0:1789123284.472335:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343b0f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+12:14653:x1876031381268864:12345-0@lo:101:mount.lustre.0 Request processed in 164us (7089us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123284.472353:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789123284.472854:0:14653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035a8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381268864:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789123284.472884:0:14653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f343bd32400/0x7e1648d68fc92c0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92c14 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123284.472894:0:14653:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f343bd32400/0x7e1648d68fc92c0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc92c14 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123284.472963:0:14653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381268992:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789123284.472998:0:14653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123284.473019:0:14653:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f33012449c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789123284.473047:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381268992 00000100:00100000:0.0:1789123284.473058:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381268992 00000100:00100000:0.0:1789123284.473087:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789123284.473094:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343b0f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+12:14653:x1876031381268992:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789123284.473320:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343b0f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+12:14653:x1876031381268992:12345-0@lo:501:mount.lustre.0 Request processed in 226us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123284.473327:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789123284.473358:0:14653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381268992:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789123284.473383:0:14653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381269120:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789123284.473416:0:14653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123284.473428:0:14653:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f33012449c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789123284.473438:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381269120 00000100:00100000:0.0:1789123284.473441:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381269120 00000100:00100000:0.0:1789123284.473457:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789123284.473462:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343b0f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+12:14653:x1876031381269120:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789123284.473578:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343b0f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+12:14653:x1876031381269120:12345-0@lo:503:mount.lustre.0 Request processed in 115us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123284.473585:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789123284.473615:0:14653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381269120:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789123284.473918:0:14698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39ef4522-e133-4b32-b80c-ca92d5b19344:14698:1876031381269248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789123284.473949:0:14698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123284.473965:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381269248 00000100:00100000:0.0:1789123284.473968:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381269248 00000100:00100000:0.0:1789123284.473986:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789123284.473991:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343b0f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+12:14698:x1876031381269248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789123284.474205:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343b0f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+12:14698:x1876031381269248:12345-0@lo:502:llog_process_th.0 Request processed in 213us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123284.474217:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789123284.474246:0:14698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3301244f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789123284.474260:0:14698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39ef4522-e133-4b32-b80c-ca92d5b19344:14698:1876031381269248:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1789123284.474311:0:14698:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789123284.474326:0:14698:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9f342d8aced8) 00000020:00000080:0.0:1789123284.474345:0:14698:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1789123284.474415:0:14698:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f343fca3000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789123284.474419:0:14698:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f343fca3000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789123284.474422:0:14698:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f343fca3000 4 00010000:00080000:0.0:1789123284.474452:0:14698:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f3408cec000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.130@tcp at head 00010000:00010000:0.0:1789123284.484602:0:14698:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1789123284.484984:0:14698:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789123284.485020:0:14698:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789123284.485096:0:14698:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x7e1648d68fc92c22 00000100:00080000:0.0:1789123284.485107:0:14698:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789123284.485112:0:14698:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9f3408cec000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:0.0:1789123284.485147:0:14698:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f34062d8f00 x1876031381269376/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789123284.485244:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876031381269376:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789123284.485318:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123284.485434:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381269376 00000100:00100000:3.0:1789123284.485441:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381269376 00000100:00100000:3.0:1789123284.485469:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789123284.485476:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f33035abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1876031381269376:12345-0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789123284.485535:0:14698:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789123284.497919:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f33035abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1876031381269376:12345-0@lo:38:llog_process_th.0 Request processed in 12432us (12592us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789123284.497934:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789123284.498925:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789123284.498937:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9f3408cec000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789123284.498943:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789123284.498947:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876031381269376:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789123284.503221:0:14698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39ef4522-e133-4b32-b80c-ca92d5b19344:14698:1876031381269504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789123284.503307:0:14698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123284.503343:0:14698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3301244480 going to sleep for 11 seconds 00000100:00100000:0.0:1789123284.503363:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381269504 00000100:00100000:0.0:1789123284.503369:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381269504 00000100:00100000:0.0:1789123284.503405:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789123284.503413:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+12:14698:x1876031381269504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789123284.503803:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+12:14698:x1876031381269504:12345-0@lo:502:llog_process_th.0 Request processed in 389us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123284.503811:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789123284.503876:0:14698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39ef4522-e133-4b32-b80c-ca92d5b19344:14698:1876031381269504:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789123284.503902:0:14698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789123284.503993:0:14653:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789123284.504011:0:14653:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789123284.504024:0:14653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd32400/0x7e1648d68fc92c0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92c14 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123284.504098:0:14653:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f343bd32400/0x7e1648d68fc92c0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92c14 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789123284.504149:0:14653:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789123284.504151:0:14653:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789123284.504153:0:14653:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789123284.504154:0:14653:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789123284.504155:0:14653:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789123284.504156:0:14653:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789123284.504158:0:14653:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789123284.504159:0:14653:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789123284.504161:0:14653:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789123284.504162:0:14653:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789123284.504166:0:14653:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789123284.504168:0:14653:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789123284.504169:0:14653:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789123284.504170:0:14653:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789123284.504171:0:14653:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789123284.504172:0:14653:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789123284.504174:0:14653:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789123284.504175:0:14653:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789123284.504176:0:14653:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789123284.504177:0:14653:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789123284.504183:0:14653:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789123284.504197:0:14653:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789123284.504207:0:14653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381269632:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789123284.504236:0:14653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123284.504250:0:14653:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3301244480 going to sleep for 11 seconds 00000100:00100000:1.0:1789123284.504845:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381269632 00000100:00100000:1.0:1789123284.504853:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381269632 00000100:00100000:1.0:1789123284.504901:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789123284.504909:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+12:14653:x1876031381269632:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789123284.504945:0:14666:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789123284.504960:0:14666:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789123284.582825:0:14666:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789123284.582844:0:14666:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789123284.582873:0:14686:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789123284.582880:0:14686:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789123284.582901:0:14686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f342d80aa00/0x7e1648d68fc92c29 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123284.582919:0:14686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f342d80a800/0x7e1648d68fc92bf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc92bf1 expref: 12 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123284.582927:0:14686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f342d80aa00/0x7e1648d68fc92c29 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123284.583099:0:14686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f342d80a800/0x7e1648d68fc92bf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc92bf1 expref: 12 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123284.583132:0:14686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f342d80a800/0x7e1648d68fc92bf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc92bf1 expref: 12 pid: 14663 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123284.583457:0:14686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c309680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14686:1876031381269760:0@lo:104: 00000100:00100000:2.0:1789123284.583518:0:14686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123284.583580:0:14686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408f1c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789123284.583924:0:14654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381269760 00000100:00100000:0.0:1789123284.583932:0:14654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381269760 00000100:00100000:0.0:1789123284.584364:0:14654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789123284.585111:0:14654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39ef4522-e133-4b32-b80c-ca92d5b19344+3:14686:x1876031381269760:12345-0@lo:104: 00010000:00010000:0.0:1789123284.585354:0:14654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f343bd33200/0x7e1648d68fc92bf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc92bf8 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123284.585490:0:14654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789123284.585497:0:14654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39ef4522-e133-4b32-b80c-ca92d5b19344+3:14686:x1876031381269760:12345-0@lo:104: Request processed in 393us (1978us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123284.585505:0:14654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789123284.585909:0:14660:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789123284.585926:0:14660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f343bd33200/0x7e1648d68fc92bf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc92bf8 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123284.585935:0:14660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33200 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:3.0:1789123284.585940:0:14660:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f343bd33200/0x7e1648d68fc92bf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc92bf8 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123284.585948:0:14660:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f343bd33200/0x7e1648d68fc92bf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc92bf8 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789123284.585956:0:14660:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f343bd33200/0x7e1648d68fc92bf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc92bf8 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789123284.585961:0:14660:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789123284.585997:0:14660:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f343bd33200/0x7e1648d68fc92bf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc92bf8 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123284.586003:0:14660:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789123284.586020:0:14660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f343bd33200/0x7e1648d68fc92bf1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc92bf8 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123284.586976:0:14660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f343bd33200/0x7e1648d68fc92bf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc92bf8 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123284.586993:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123284.586995:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123284.586996:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123284.587242:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39ef4522-e133-4b32-b80c-ca92d5b19344:3303:1876031381269888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789123284.587308:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123284.587851:0:14656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381269888 00000100:00100000:3.0:1789123284.587869:0:14656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381269888 00010000:00010000:3.0:1789123284.587897:0:14656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f342d80a800/0x7e1648d68fc92bf8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc92bf1 expref: 13 pid: 14663 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123284.587943:0:14656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789123284.587953:0:14656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39ef4522-e133-4b32-b80c-ca92d5b19344+13:3303:x1876031381269888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789123284.587966:0:14656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123284.587971:0:14656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f342d80a800/0x7e1648d68fc92bf8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc92bf1 expref: 13 pid: 14663 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123284.587982:0:14656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f342d80a800/0x7e1648d68fc92bf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc92bf1 expref: 13 pid: 14663 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123284.588002:0:14656:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f342d80aa00/0x7e1648d68fc92c29 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123284.588010:0:14656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f342d80aa00/0x7e1648d68fc92c29 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789123284.588025:0:14656:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005146249s 00010000:00010000:3.0:1789123284.588029:0:14656:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f342d80aa00/0x7e1648d68fc92c29 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123284.588963:0:14656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f342d80aa00/0x7e1648d68fc92c29 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123284.588970:0:14656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f342d80aa00/0x7e1648d68fc92c29 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123284.588976:0:14656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f342d80aa00/0x7e1648d68fc92c29 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123284.588983:0:14656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80aa00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:3.0:1789123284.588987:0:14656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f342d80aa00/0x7e1648d68fc92c29 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123284.588996:0:14656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f342d80aa00/0x7e1648d68fc92c29 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123284.589006:0:14656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f342d80aa00/0x7e1648d68fc92c29 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123284.589019:0:14656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789123284.589258:0:14656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39ef4522-e133-4b32-b80c-ca92d5b19344+13:3303:x1876031381269888:12345-0@lo:103:ldlm_bl.0 Request processed in 1304us (1947us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123284.589268:0:14656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789123284.590264:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39ef4522-e133-4b32-b80c-ca92d5b19344:3303:1876031381269888:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789123284.593010:0:14686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f342d80a800/0x7e1648d68fc92bf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc92bf1 expref: 12 pid: 14663 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123284.593039:0:14686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c309680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14686:1876031381269760:0@lo:104: 00010000:00010000:1.0:1789123284.593062:0:14686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f342d80aa00/0x7e1648d68fc92c29 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123284.593125:0:14686:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f342d80aa00/0x7e1648d68fc92c29 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123284.593143:0:14686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f342d80aa00/0x7e1648d68fc92c29 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123284.593149:0:14686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f342d80aa00/0x7e1648d68fc92c29 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123284.614371:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+11:14653:x1876031381269632:12345-0@lo:253:mount.lustre.0 Request processed in 109452us (110123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123284.614387:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789123284.614525:0:14653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:14653:1876031381269632:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789123284.614544:0:14653:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789123284.614548:0:14653:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789123284.614550:0:14653:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789123284.614551:0:14653:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789123284.614552:0:14653:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789123284.614554:0:14653:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789123284.614555:0:14653:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789123284.614556:0:14653:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789123284.614558:0:14653:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789123284.614559:0:14653:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789123284.614578:0:14653:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789123284.614596:0:14653:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789123284.622661:0:14653:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1789123284.622832:0:14653:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789123284.623605:0:14653:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1789123284.623799:0:14653:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789123284.626831:0:14653:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1789123284.627250:0:14653:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1789123284.629757:0:14653:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1789123284.629954:0:14653:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1789123284.630744:0:14653:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1789123284.631328:0:14653:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1789123284.632719:0:14653:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1789123284.633596:0:14653:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1789123284.672233:0:14653:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1789123284.672621:0:14653:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1789123284.673357:0:14711:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1789123284.673432:0:14711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1789123284.677113:0:14710:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1789123284.677120:0:14710:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:1.0:1789123284.679429:0:14711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789123284.679492:0:14711:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789123284.679496:0:14711:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1789123284.681202:0:14653:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789123284.681351:0:14653:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789123284.682052:0:14653:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789123284.682381:0:14653:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789123284.682959:0:14653:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789123284.684156:0:14653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789123284.684715:0:14653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789123284.684747:0:14653:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1789123284.689667:0:14653:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1789123284.696225:0:14653:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1789123284.742492:0:14653:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789123284.742526:0:14653:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffba00c1943988 00100000:10000000:1.0:1789123284.742536:0:14653:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789123284.743314:0:14653:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789123284.743329:0:14653:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.130@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789123284.743351:0:14653:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789123284.743366:0:14653:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1789123285.124761:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789123285.573623:0:14707:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1789123286.148756:0:14668:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789123286.148764:0:14668:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f343fca3000 from 6 10000000:01000000:0.0:1789123286.148770:0:14668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789123286.148817:0:14668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3435b52c00/0x7e1648d68fc92c30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123286.148829:0:14668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f3435b52c00/0x7e1648d68fc92c30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123286.148841:0:14668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f3435b52c00/0x7e1648d68fc92c30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123286.148891:0:14668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062da940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381270016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789123286.148975:0:14668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123286.149034:0:14668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410bcec00 going to sleep for 11 seconds 00000100:00100000:2.0:1789123286.149098:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381270016 00000100:00100000:2.0:1789123286.149106:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381270016 00000100:00100000:2.0:1789123286.149216:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1789123286.149265:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123286.149269:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+11:14668:x1876031381270016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789123286.149283:0:14665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123286.149296:0:14665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3402fbaa00/0x7e1648d68fc92c37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc92c30 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123286.149328:0:14665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3402fbaa00/0x7e1648d68fc92c37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc92c30 expref: 12 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123286.149338:0:14665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3402fbaa00/0x7e1648d68fc92c37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc92c30 expref: 12 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123286.149347:0:14665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbaa00, rc 0) 00000100:00100000:3.0:1789123286.149395:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+12:14668:x1876031381270016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123286.149402:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789123286.149491:0:14668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062da940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381270016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789123286.149506:0:14668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f3435b52c00/0x7e1648d68fc92c30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92c37 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123286.149514:0:14668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f3435b52c00/0x7e1648d68fc92c30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc92c37 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123286.149562:0:14668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062da940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381270144:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789123286.149592:0:14668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123286.149705:0:14668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410bcec00 going to sleep for 11 seconds 00000100:00100000:2.0:1789123286.154105:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381270144 00000100:00100000:2.0:1789123286.154121:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381270144 00000100:00100000:2.0:1789123286.154186:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789123286.154196:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+12:14668:x1876031381270144:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789123286.154222:0:14666:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789123286.154243:0:14666:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789123286.154246:0:14666:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789123286.157603:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+12:14668:x1876031381270144:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 3399us (8000us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123286.157619:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789123286.158027:0:14668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062da940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381270144:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789123286.158088:0:14668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789123286.158097:0:14668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3435b52c00/0x7e1648d68fc92c30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92c37 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123286.158107:0:14668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f3435b52c00/0x7e1648d68fc92c30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92c37 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789123286.598097:0:14707:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789123287.178731:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123288.199347:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789123289.211825:0:14953:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789123289.222190:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789123289.607153:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789123289.607159:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789123289.607162:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789123289.607165:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789123289.607181:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789123289.607184:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789123289.607189:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f3408cec000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789123289.607200:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9f3408cec000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:0.0:1789123289.607220:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f34062d9a40 x1876031381270400/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789123289.607278:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39ef4522-e133-4b32-b80c-ca92d5b19344:3304:1876031381270272:0@lo:400:kworker.0 00000100:00100000:0.0:1789123289.607345:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123289.609886:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876031381270400:0@lo:38:kworker.0 00000100:00100000:3.0:1789123289.610005:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123289.610050:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381270272 00000100:00100000:3.0:1789123289.610057:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381270272 00000100:00100000:3.0:1789123289.610107:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789123289.610117:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+12:3304:x1876031381270272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123289.610172:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+12:3304:x1876031381270272:12345-0@lo:400:kworker.0 Request processed in 56us (2827us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123289.610179:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789123289.610226:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39ef4522-e133-4b32-b80c-ca92d5b19344:3304:1876031381270272:0@lo:400:kworker.0 00000100:00100000:0.0:1789123289.610330:0:14672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381270400 00000100:00100000:0.0:1789123289.610334:0:14672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381270400 00000100:00100000:0.0:1789123289.610362:0:14672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789123289.610366:0:14672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1876031381270400:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789123289.610386:0:14672:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 403 last 0 00000020:00000080:0.0:1789123289.610420:0:14672:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x7e1648d68fc92c3e 00000004:00100000:0.0:1789123289.610434:0:14672:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789123289.610551:0:14672:0:(import.c:65:import_set_state_nolock()) ffff9f3403cc8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789123289.610612:0:14672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876031381270400:12345-0@lo:38:kworker.0 Request processed in 243us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123289.610619:0:14672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789123289.610718:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f34062d9a40 x1876031381270400/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789123299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789123289.610732:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789123289.610739:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789123289.610743:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789123289.610745:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9f3408cec000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789123289.610750:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876031381270400:0@lo:38:kworker.0 00010000:00010000:2.0:1789123290.250190:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123291.270808:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123292.294266:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789123292.383056:0:15104:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe5168cc80 20000000:00000080:3.0:1789123292.383080:0:15104:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f343c6d8c00 uarg=0000000000000000 20000000:01000000:3.0:1789123292.383120:0:15104:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789123292.383793:0:15104:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789123292.383803:0:15104:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789123292.388535:0:15105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1789123292.388955:0:15104:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789123292.416509:0:15104:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789123292.417150:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f342d80a400/0x7e1648d68fc92c45 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123292.417178:0:15104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f343bd33000/0x7e1648d68fc92c06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc92bff expref: 11 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123292.417187:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f342d80a400/0x7e1648d68fc92c45 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123292.417249:0:15104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f343bd33000/0x7e1648d68fc92c06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc92bff expref: 11 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123292.417270:0:15104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f343bd33000/0x7e1648d68fc92c06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc92bff expref: 11 pid: 14663 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123292.417289:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c3083c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15104:1876031381270528:0@lo:104: 00000100:00100000:2.0:1789123292.417376:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123292.417440:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3418b81180 going to sleep for 11 seconds 00000100:00100000:1.0:1789123292.417845:0:14654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381270528 00000100:00100000:1.0:1789123292.417858:0:14654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381270528 00000100:00100000:1.0:1789123292.417922:0:14654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789123292.417932:0:14654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c308b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39ef4522-e133-4b32-b80c-ca92d5b19344+3:15104:x1876031381270528:12345-0@lo:104: 00010000:00010000:1.0:1789123292.417950:0:14654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f3435b53e00/0x7e1648d68fc92bff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc92c06 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123292.418054:0:14654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789123292.418063:0:14654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c308b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39ef4522-e133-4b32-b80c-ca92d5b19344+3:15104:x1876031381270528:12345-0@lo:104: Request processed in 132us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123292.418072:0:14654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789123292.418103:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789123292.418111:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f3435b53e00/0x7e1648d68fc92bff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc92c06 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123292.418112:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c3083c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15104:1876031381270528:0@lo:104: 00010000:00010000:1.0:1789123292.418148:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53e00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:1.0:1789123292.418153:0:14659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f3435b53e00/0x7e1648d68fc92bff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc92c06 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123292.418159:0:15104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f342d80a400/0x7e1648d68fc92c45 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123292.418162:0:14659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f3435b53e00/0x7e1648d68fc92bff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc92c06 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789123292.418169:0:14659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f3435b53e00/0x7e1648d68fc92bff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc92c06 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789123292.418174:0:14659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789123292.418218:0:14659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f3435b53e00/0x7e1648d68fc92bff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc92c06 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123292.418226:0:14659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789123292.418294:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39ef4522-e133-4b32-b80c-ca92d5b19344:3305:1876031381270656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789123292.418345:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123292.418495:0:14657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381270656 00000100:00100000:2.0:1789123292.418503:0:14657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381270656 00010000:00010000:2.0:1789123292.418534:0:14657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f343bd33000/0x7e1648d68fc92c06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc92bff expref: 12 pid: 14663 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123292.418567:0:14657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789123292.418575:0:14657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39ef4522-e133-4b32-b80c-ca92d5b19344+12:3305:x1876031381270656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789123292.418589:0:14657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123292.418595:0:14657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f343bd33000/0x7e1648d68fc92c06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc92bff expref: 12 pid: 14663 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123292.418654:0:14657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f343bd33000/0x7e1648d68fc92c06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc92bff expref: 12 pid: 14663 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123292.418675:0:14657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f343bd33000/0x7e1648d68fc92c06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc92bff expref: 12 pid: 14663 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123292.418693:0:14657:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f342d80a400/0x7e1648d68fc92c45 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123292.418701:0:14657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f342d80a400/0x7e1648d68fc92c45 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123292.418718:0:14657:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f342d80a400/0x7e1648d68fc92c45 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123292.418726:0:14657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f342d80a400/0x7e1648d68fc92c45 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123292.418733:0:14657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f342d80a400/0x7e1648d68fc92c45 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123292.418739:0:14657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f342d80a400/0x7e1648d68fc92c45 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123292.418745:0:14657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a400 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:2.0:1789123292.418749:0:14657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f342d80a400/0x7e1648d68fc92c45 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123292.418756:0:14657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f342d80a400/0x7e1648d68fc92c45 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123292.418782:0:14657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f342d80a400/0x7e1648d68fc92c45 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123292.418793:0:14657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789123292.419522:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f3435b53e00/0x7e1648d68fc92bff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc92c06 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123292.419534:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f3435b53e00/0x7e1648d68fc92bff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc92c06 expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123292.421474:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123292.421487:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123292.421490:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123292.428442:0:14657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39ef4522-e133-4b32-b80c-ca92d5b19344+11:3305:x1876031381270656:12345-0@lo:103:ldlm_bl.0 Request processed in 9849us (10078us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123292.428463:0:14657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789123292.428834:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39ef4522-e133-4b32-b80c-ca92d5b19344:3305:1876031381270656:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789123292.428884:0:15104:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f342d80a400/0x7e1648d68fc92c45 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123292.428900:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f342d80a400/0x7e1648d68fc92c45 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123292.428928:0:15104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f342d80a400/0x7e1648d68fc92c45 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123293.317069:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789123294.021022:0:14668:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789123294.021031:0:14668:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f343fca3000 from 13 10000000:01000000:0.0:1789123294.021035:0:14668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789123294.021077:0:14668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3435b52e00/0x7e1648d68fc92c4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123294.021089:0:14668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f3435b52e00/0x7e1648d68fc92c4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123294.021101:0:14668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f3435b52e00/0x7e1648d68fc92c4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123294.021132:0:14668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381270784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789123294.021207:0:14668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123294.021302:0:14668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3441ecbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789123294.025332:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381270784 00000100:00100000:2.0:1789123294.025347:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381270784 00000100:00100000:2.0:1789123294.025429:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789123294.025441:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301296850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+11:14668:x1876031381270784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789123294.025460:0:14666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123294.025485:0:14666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f342d80b000/0x7e1648d68fc92c53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc92c4c expref: -99 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123294.025514:0:14666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f342d80b000/0x7e1648d68fc92c53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc92c4c expref: 12 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123294.025526:0:14666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f342d80b000/0x7e1648d68fc92c53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc92c4c expref: 12 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123294.025536:0:14666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80b000, rc 0) 00000100:00100000:2.0:1789123294.025624:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301296850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+12:14668:x1876031381270784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (4415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123294.025670:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789123294.028466:0:14668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381270784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789123294.028496:0:14668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f3435b52e00/0x7e1648d68fc92c4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92c53 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123294.028509:0:14668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f3435b52e00/0x7e1648d68fc92c4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc92c53 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123294.028604:0:14668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381270912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789123294.028687:0:14668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123294.028744:0:14668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3441ecbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789123294.028969:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381270912 00000100:00100000:1.0:1789123294.028985:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381270912 00000100:00100000:1.0:1789123294.029031:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789123294.029041:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+12:14668:x1876031381270912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789123294.029357:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+12:14668:x1876031381270912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 317us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123294.029374:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789123294.029915:0:14668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381270912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789123294.029956:0:14668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381271040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789123294.030011:0:14668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123294.030043:0:14668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3441ecbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789123294.030056:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381271040 00000100:00100000:0.0:1789123294.030060:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381271040 00000100:00100000:0.0:1789123294.030095:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789123294.030103:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+12:14668:x1876031381271040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789123294.030381:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+12:14668:x1876031381271040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 278us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123294.030389:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789123294.030430:0:14668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381271040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789123294.031372:0:15172:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789123294.031874:0:14668:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789123294.031892:0:14668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789123294.031904:0:14668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3435b52e00/0x7e1648d68fc92c4c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92c53 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123294.031915:0:14668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f3435b52e00/0x7e1648d68fc92c4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92c53 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123294.341019:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789123294.724866:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789123294.724875:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789123294.724878:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789123294.724882:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789123294.725204:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876031381271296:0@lo:400:kworker.0 00000100:00100000:3.0:1789123294.725302:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123294.725445:0:3301:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789123284/real 1789123284] req@ffff9f343c30a580 x1876031381267712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789123294 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123294.725474:0:3301:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f343c30a580 x1876031381267712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789123294 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123294.725487:0:3301:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789123284/real 1789123284] req@ffff9f34062c8780 x1876031381267584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789123294 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123294.725502:0:3301:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f34062c8780 x1876031381267584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789123294 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789123294.725524:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9f343b0d7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1789123294.725527:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39ef4522-e133-4b32-b80c-ca92d5b19344:3302:1876031381271168:0@lo:400:kworker.0 00000100:00080000:0.0:1789123294.725545:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789123294.725552:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c30a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876031381267712:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789123294.725562:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9f33012b6000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789123294.725569:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789123294.725573:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062c8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876031381267584:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789123294.725609:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789123294.725613:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789123294.725616:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f33012b6000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789123294.725624:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 398 00000100:00100000:1.0:1789123294.725678:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123294.725737:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381271168 00000100:00100000:1.0:1789123294.725746:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381271168 00000100:00080000:0.0:1789123294.725950:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789123294.725959:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f33012b6000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:0.0:1789123294.725991:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f34062db840 x1876031381271424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789123294.726010:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789123294.726020:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789123294.726022:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f343b0d7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789123294.726026:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 398 00000100:00080000:0.0:1789123294.726028:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789123294.726032:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f343b0d7000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:0.0:1789123294.726047:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f34062d9680 x1876031381271552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789123294.726071:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876031381271424:0@lo:8:kworker.0 00000400:00000100:0.0:1789123294.726258:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876031381271424 offset 0 length 520: 4 00000100:00100000:0.0:1789123294.726470:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876031381271552:0@lo:8:kworker.0 00000400:00000100:0.0:1789123294.726493:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876031381271552 offset 0 length 520: 4 00000100:00100000:3.0:1789123294.726574:0:14671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381271296 00000100:00100000:3.0:1789123294.726582:0:14671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381271296 00000100:00100000:3.0:1789123294.726665:0:14671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789123294.726680:0:14671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876031381271296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123294.726715:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789123294.726733:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+12:3302:x1876031381271168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123294.726892:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+12:3302:x1876031381271168:12345-0@lo:400:kworker.0 Request processed in 165us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123294.726901:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789123294.726972:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39ef4522-e133-4b32-b80c-ca92d5b19344:3302:1876031381271168:0@lo:400:kworker.0 00000100:00100000:3.0:1789123294.727920:0:14671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876031381271296:12345-0@lo:400:kworker.0 Request processed in 1240us (2614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123294.727936:0:14671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789123294.728565:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f34062da1c0 x1876031381271296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123294.728584:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876031381271296:0@lo:400:kworker.0 00010000:00010000:1.0:1789123295.367355:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123296.388742:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789123296.847065:0:14707:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789123297.417152:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789123297.434131:0:15353:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789123297.434136:0:15353:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789123297.435234:0:15353:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f3406272800 00000020:01000004:2.0:1789123297.435254:0:15353:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789123297.435266:0:15353:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789123297.435282:0:15353:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9f3441ea4ed8) 00000020:00000080:2.0:1789123297.435298:0:15353:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789123297.460972:0:15353:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789123297.461371:0:15353:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789123297.466425:0:15353:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789123297.468282:0:15353:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789123297.468537:0:15353:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789123297.473888:0:15353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 615: rc = 0 00100000:10000000:3.0:1789123297.476124:0:15353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 615: rc = 0 00100000:10000000:3.0:1789123297.476299:0:15353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 615: rc = 0 00100000:10000000:3.0:1789123297.478500:0:15353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 418: rc = 0 00100000:10000000:3.0:1789123297.481392:0:15353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 418: rc = 0 00100000:10000000:3.0:1789123297.482292:0:15353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 418: rc = 0 00100000:10000000:3.0:1789123297.482941:0:15353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 418: rc = 0 00100000:10000000:3.0:1789123297.483421:0:15353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 418: rc = 0 00100000:10000000:3.0:1789123297.484206:0:15353:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 418: rc = 0 00000020:00000080:2.0:1789123297.487909:0:15353:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789123297.487922:0:15353:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789123297.487932:0:15353:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7e1648d68fc92c61 00000020:01000004:2.0:1789123297.487939:0:15353:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789123297.488029:0:15353:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.130@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789123297.488033:0:15353:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789123297.488040:0:15353:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789123297.488044:0:15353:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789123297.488056:0:15353:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9f3441ea3490) 00000020:00000080:2.0:1789123297.488066:0:15353:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1789123297.492385:0:15353:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789123297.496287:0:15353:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789123297.496295:0:15353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789123297.502471:0:15353:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789123297.502483:0:15353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789123297.503055:0:15353:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789123297.503063:0:15353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789123297.504471:0:15353:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789123297.505429:0:15353:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789123297.505437:0:15353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789123297.508426:0:15353:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789123297.508444:0:15353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789123297.535451:0:15353:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789123297.536051:0:15353:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789123297.536059:0:15353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789123297.538365:0:15353:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789123297.538378:0:15353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789123297.542481:0:15353:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789123297.542918:0:15353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789123297.548493:0:15353:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789123297.549215:0:15353:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789123297.549222:0:15353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789123297.550263:0:15353:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789123297.550273:0:15353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789123297.601095:0:15353:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789123297.601297:0:15353:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789123297.601304:0:15353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789123297.604214:0:15353:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789123297.604229:0:15353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789123297.605209:0:15353:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789123297.605233:0:15353:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789123297.605239:0:15353:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.130@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789123297.619976:0:15353:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.130@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789123297.620017:0:15353:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.130@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1789123297.620022:0:15353:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789123297.620024:0:15353:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789123297.620025:0:15353:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789123297.620027:0:15353:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789123297.620028:0:15353:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789123297.620029:0:15353:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789123297.620031:0:15353:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789123297.620033:0:15353:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789123297.620034:0:15353:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789123297.620038:0:15353:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1789123297.620040:0:15353:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789123297.620041:0:15353:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789123297.620042:0:15353:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789123297.620043:0:15353:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789123297.620044:0:15353:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789123297.620045:0:15353:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789123297.620046:0:15353:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789123297.620047:0:15353:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789123297.620048:0:15353:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789123297.620072:0:15353:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789123297.620091:0:15353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c3092c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381271680:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789123297.620175:0:15353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123297.620273:0:15353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3435910480 going to sleep for 11 seconds 00000100:00100000:1.0:1789123297.620413:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381271680 00000100:00100000:1.0:1789123297.620421:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381271680 00000100:00100000:1.0:1789123297.620511:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789123297.620531:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+12:15353:x1876031381271680:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789123297.620569:0:14663:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789123297.620572:0:14663:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1789123297.620576:0:14663:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789123297.635020:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+12:15353:x1876031381271680:12345-0@lo:253:mount.lustre.0 Request processed in 14484us (14837us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123297.635034:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789123297.635159:0:15353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c3092c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381271680:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789123297.635175:0:15353:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789123297.635178:0:15353:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789123297.635179:0:15353:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789123297.635181:0:15353:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789123297.635182:0:15353:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789123297.635183:0:15353:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789123297.635184:0:15353:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789123297.635186:0:15353:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789123297.635188:0:15353:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789123297.635189:0:15353:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789123297.635211:0:15353:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f3406272800 from lustre-OST0000 10000000:01000000:2.0:1789123297.635238:0:15353:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789123297.635252:0:15353:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789123297.635259:0:15353:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f34066aced8 local copy 00010000:00010000:2.0:1789123297.635270:0:15353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd32600/0x7e1648d68fc92b57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92b5e expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123297.635904:0:15353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c3092c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381271808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789123297.635952:0:15353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123297.636048:0:15353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3435910a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789123297.636089:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381271808 00000100:00100000:1.0:1789123297.636096:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381271808 00000100:00100000:1.0:1789123297.636187:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789123297.636197:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+12:15353:x1876031381271808:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789123297.636463:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+12:15353:x1876031381271808:12345-0@lo:501:mount.lustre.0 Request processed in 267us (509us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789123297.636471:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789123297.636547:0:15353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c3092c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381271808:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789123297.636577:0:15353:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789123297.636812:0:15353:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789123297.636821:0:15353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd32600/0x7e1648d68fc92b57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92b5e expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123297.636831:0:15353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f343bd32600/0x7e1648d68fc92b57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92b5e expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123297.636853:0:15353:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f3406272800 10000000:01000000:2.0:1789123297.636858:0:15353:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789123297.636863:0:15353:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9f34066aced8 10000000:01000000:2.0:1789123297.636865:0:15353:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789123297.636868:0:15353:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9f34066aced8 from 1 10000000:01000000:2.0:1789123297.636871:0:15353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789123297.636900:0:15353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f342d80a000/0x7e1648d68fc92c6f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123297.636907:0:15353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f342d80a000/0x7e1648d68fc92c6f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123297.636930:0:15353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f342d80a000/0x7e1648d68fc92c6f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123297.636945:0:15353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c3092c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381271936:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789123297.636975:0:15353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123297.637944:0:15353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3435910a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789123297.638012:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381271936 00000100:00100000:0.0:1789123297.638020:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381271936 00000100:00100000:0.0:1789123297.638056:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789123297.638064:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+12:15353:x1876031381271936:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789123297.638077:0:14666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123297.638093:0:14666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3435b53e00/0x7e1648d68fc92c76 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc92c6f expref: -99 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123297.638128:0:14666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3435b53e00/0x7e1648d68fc92c76 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc92c6f expref: 13 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123297.638138:0:14666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3435b53e00/0x7e1648d68fc92c76 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc92c6f expref: 13 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123297.638147:0:14666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53e00, rc 0) 00000100:00100000:0.0:1789123297.638205:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+13:15353:x1876031381271936:12345-0@lo:101:mount.lustre.0 Request processed in 141us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123297.638211:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789123297.638306:0:15353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c3092c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381271936:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789123297.638333:0:15353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f342d80a000/0x7e1648d68fc92c6f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92c76 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123297.638342:0:15353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f342d80a000/0x7e1648d68fc92c6f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc92c76 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123297.638360:0:15353:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789123297.638376:0:15353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f342d80a000/0x7e1648d68fc92c6f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92c76 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123297.638383:0:15353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f342d80a000/0x7e1648d68fc92c6f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92c76 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123297.638390:0:15353:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789123297.638394:0:15353:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789123297.638399:0:15353:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789123297.638401:0:15353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789123297.638422:0:15353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f342d80b600/0x7e1648d68fc92c7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123297.638430:0:15353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f342d80b600/0x7e1648d68fc92c7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123297.638446:0:15353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f342d80b600/0x7e1648d68fc92c7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123297.638463:0:15353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c3092c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381272064:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789123297.638495:0:15353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123297.638509:0:15353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3435910a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789123297.638814:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381272064 00000100:00100000:0.0:1789123297.638820:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381272064 00000100:00100000:0.0:1789123297.638848:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789123297.638855:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+13:15353:x1876031381272064:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789123297.638863:0:14666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123297.638872:0:14666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3435b53000/0x7e1648d68fc92c84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc92c7d expref: -99 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123297.638888:0:14666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3435b53000/0x7e1648d68fc92c84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc92c7d expref: 14 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123297.638897:0:14666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3435b53000/0x7e1648d68fc92c84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc92c7d expref: 14 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123297.638903:0:14666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53000, rc 0) 00000100:00100000:0.0:1789123297.638949:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+14:15353:x1876031381272064:12345-0@lo:101:mount.lustre.0 Request processed in 95us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123297.638965:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789123297.639107:0:15353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c3092c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381272064:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789123297.639121:0:15353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f342d80b600/0x7e1648d68fc92c7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92c84 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123297.639128:0:15353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f342d80b600/0x7e1648d68fc92c7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc92c84 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789123297.641389:0:15353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789123297.643326:0:15353:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789123297.644115:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789123297.644173:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789123297.644208:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789123297.644256:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789123297.644297:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789123297.644347:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789123297.644422:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789123297.644430:0:15353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789123297.644519:0:15353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c3092c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381272192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789123297.644988:0:15353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123297.645035:0:15353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3435910f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789123297.645105:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381272192 00000100:00100000:0.0:1789123297.645112:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381272192 00000100:00100000:0.0:1789123297.645160:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789123297.645169:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343bf12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+14:15353:x1876031381272192:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789123297.646098:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343bf12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+14:15353:x1876031381272192:12345-0@lo:501:mount.lustre.0 Request processed in 927us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123297.646121:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789123297.646213:0:15353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c3092c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381272192:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789123297.646258:0:15353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062dad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381272320:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789123297.646303:0:15353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123297.646395:0:15353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408f1cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789123297.646453:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381272320 00000100:00100000:1.0:1789123297.646460:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381272320 00000100:00100000:1.0:1789123297.646498:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789123297.646506:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343bf11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+14:15353:x1876031381272320:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789123297.647142:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343bf11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+14:15353:x1876031381272320:12345-0@lo:503:mount.lustre.0 Request processed in 636us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123297.647151:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789123297.647309:0:15353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062dad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381272320:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789123297.650136:0:15353:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789123297.650238:0:15353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035aa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381272448:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789123297.650947:0:15353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123297.651049:0:15353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408e599c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789123297.651104:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381272448 00000100:00100000:0.0:1789123297.651112:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381272448 00000100:00100000:0.0:1789123297.651196:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789123297.651205:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343bf10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+14:15353:x1876031381272448:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789123297.651500:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343bf10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+14:15353:x1876031381272448:12345-0@lo:502:mount.lustre.0 Request processed in 295us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123297.651509:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789123297.651689:0:15353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035aa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381272448:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789123297.652052:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789123297.652110:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789123297.652148:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789123297.652197:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789123297.652235:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789123297.652271:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789123297.652336:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789123297.652375:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789123297.652410:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1789123297.652472:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1789123297.652508:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1789123297.652891:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1789123297.652948:0:15353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035aa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381272576:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789123297.653011:0:15353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123297.653103:0:15353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340564dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789123297.654002:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381272576 00000100:00100000:3.0:1789123297.654013:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381272576 00000100:00100000:2.0:1789123297.654279:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789123297.654290:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343bf10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+14:15353:x1876031381272576:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789123297.654757:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343bf10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+14:15353:x1876031381272576:12345-0@lo:502:mount.lustre.0 Request processed in 469us (1744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123297.654767:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789123297.654939:0:15353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035aa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381272576:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789123297.655041:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1789123297.655056:0:15353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1789123297.656290:0:15367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789123297.656300:0:15367:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1789123297.656306:0:15367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789123297.656319:0:15367:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789123297.656327:0:15367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789123297.656342:0:15367:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9f343656ced8) 00000020:00000080:1.0:1789123297.656363:0:15367:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789123297.656369:0:15367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789123297.656431:0:15367:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f3406272800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789123297.656438:0:15367:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789123297.656444:0:15367:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7e1648d68fc92c92 00010000:00010000:1.0:1789123297.663387:0:15367:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1789123297.664195:0:15367:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1789123297.668492:0:15367:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:3.0:1789123297.671963:0:15367:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789123297.671976:0:15367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789123297.671982:0:15367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123297.671984:0:15367:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789123297.671988:0:15367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789123297.671991:0:15367:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1789123297.671993:0:15367:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789123297.671994:0:15367:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789123297.671996:0:15367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789123297.671999:0:15367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123297.672000:0:15367:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789123297.672002:0:15367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789123297.672005:0:15367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123297.672006:0:15367:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789123297.672009:0:15367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789123297.672011:0:15367:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789123297.672013:0:15367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789123297.672015:0:15367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123297.672016:0:15367:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789123297.672018:0:15367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789123297.672028:0:15367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123297.672029:0:15367:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789123297.672033:0:15367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789123297.672069:0:15367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789123297.672073:0:15367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123297.672074:0:15367:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789123297.672078:0:15367:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1789123297.672322:0:15353:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1789123297.672348:0:15353:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789123297.672398:0:15353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f342d80b600/0x7e1648d68fc92c7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92c84 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123297.672410:0:15353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f342d80b600/0x7e1648d68fc92c7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92c84 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789123297.672431:0:15353:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f3406272800 from 1 10000000:01000000:1.0:1789123297.672434:0:15353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789123297.672468:0:15353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd33600/0x7e1648d68fc92c99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123297.672476:0:15353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f343bd33600/0x7e1648d68fc92c99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123297.672486:0:15353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f343bd33600/0x7e1648d68fc92c99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123297.672508:0:15353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035aa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381272704:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789123297.672586:0:15353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123297.672660:0:15353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3405d373c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789123297.672910:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381272704 00000100:00100000:3.0:1789123297.672918:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381272704 00000100:00100000:3.0:1789123297.672965:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789123297.672975:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343bf12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+14:15353:x1876031381272704:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789123297.672988:0:14665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123297.673001:0:14665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3402fbae00/0x7e1648d68fc92ca0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc92c99 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123297.673024:0:14665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3402fbae00/0x7e1648d68fc92ca0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc92c99 expref: 15 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123297.673034:0:14665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3402fbae00/0x7e1648d68fc92ca0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc92c99 expref: 15 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123297.673043:0:14665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbae00, rc 0) 00000100:00100000:3.0:1789123297.673084:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343bf12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+15:15353:x1876031381272704:12345-0@lo:101:mount.lustre.0 Request processed in 110us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123297.673091:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789123297.673179:0:15353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035aa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381272704:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789123297.673194:0:15353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f343bd33600/0x7e1648d68fc92c99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92ca0 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123297.673202:0:15353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f343bd33600/0x7e1648d68fc92c99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc92ca0 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789123297.674220:0:15353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789123297.674677:0:15353:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789123297.674976:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789123297.675022:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789123297.675087:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789123297.675095:0:15353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789123297.675165:0:15353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035aa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381272832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789123297.675230:0:15353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123297.675276:0:15353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3405d373c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789123297.675363:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381272832 00000100:00100000:0.0:1789123297.675371:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381272832 00000100:00100000:0.0:1789123297.675420:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789123297.675429:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343bf13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+15:15353:x1876031381272832:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789123297.675659:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343bf13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+15:15353:x1876031381272832:12345-0@lo:501:mount.lustre.0 Request processed in 230us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123297.675667:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789123297.675979:0:15353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035aa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381272832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789123297.676015:0:15353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035aa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381272960:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789123297.676058:0:15353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123297.676130:0:15353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3405d373c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789123297.677064:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381272960 00000100:00100000:0.0:1789123297.677072:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381272960 00000100:00100000:0.0:1789123297.677111:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789123297.677120:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343bf11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+15:15353:x1876031381272960:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789123297.677308:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343bf11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+15:15353:x1876031381272960:12345-0@lo:503:mount.lustre.0 Request processed in 189us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123297.677319:0:15353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035aa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381272960:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789123297.677426:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000040:00080000:1.0:1789123297.677801:0:15353:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789123297.677864:0:15353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035aa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381273088:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789123297.677904:0:15353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123297.677935:0:15353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3405d373c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789123297.678131:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381273088 00000100:00100000:3.0:1789123297.678136:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381273088 00000100:00100000:3.0:1789123297.678206:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789123297.678215:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343bf10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+15:15353:x1876031381273088:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789123297.678385:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343bf10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+15:15353:x1876031381273088:12345-0@lo:502:mount.lustre.0 Request processed in 170us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123297.678393:0:15353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035aa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381273088:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789123297.678397:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000040:00080000:1.0:1789123297.679486:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789123297.679543:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789123297.679808:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789123297.679940:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789123297.679983:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789123297.680034:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789123297.680072:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789123297.680286:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:1.0:1789123297.681386:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:1.0:1789123297.681426:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:1.0:1789123297.681485:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10256 00000100:00100000:1.0:1789123297.681540:0:15353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035aa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381273216:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789123297.681610:0:15353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123297.681675:0:15353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3405d373c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789123297.681934:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381273216 00000100:00100000:2.0:1789123297.681941:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381273216 00000100:00100000:2.0:1789123297.682002:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789123297.682011:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3404997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+15:15353:x1876031381273216:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789123297.682210:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3404997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+15:15353:x1876031381273216:12345-0@lo:502:mount.lustre.0 Request processed in 199us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123297.682218:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789123297.682278:0:15353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035aa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381273216:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789123297.682371:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10480 00000040:00080000:1.0:1789123297.682381:0:15353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1789123297.685363:0:15371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789123297.685376:0:15371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789123297.685378:0:15371:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789123297.685385:0:15371:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f3406272800 00000020:00000080:2.0:1789123297.685388:0:15371:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789123297.685395:0:15371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789123297.685397:0:15371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789123297.685398:0:15371:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789123297.685400:0:15371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789123297.685403:0:15371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789123297.685404:0:15371:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789123297.685407:0:15371:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f3406272800 00000020:00000080:2.0:1789123297.685408:0:15371:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789123297.685482:0:15371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789123297.685486:0:15371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789123297.685494:0:15371:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789123297.685498:0:15371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789123297.685500:0:15371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789123297.685502:0:15371:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789123297.685505:0:15371:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f3406272800 00000020:00000080:2.0:1789123297.685508:0:15371:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789123297.685537:0:15371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789123297.685540:0:15371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789123297.685541:0:15371:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789123297.685544:0:15371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789123297.685546:0:15371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789123297.685547:0:15371:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789123297.685551:0:15371:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f3406272800 00000020:00000080:2.0:1789123297.685553:0:15371:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789123297.685593:0:15371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789123297.685596:0:15371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789123297.685597:0:15371:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789123297.685600:0:15371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1789123297.685892:0:15353:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789123297.685918:0:15353:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789123297.685943:0:15353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd33600/0x7e1648d68fc92c99 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92ca0 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123297.685954:0:15353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f343bd33600/0x7e1648d68fc92c99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92ca0 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789123297.685992:0:15353:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789123297.685995:0:15353:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f3406272800 10000000:01000000:1.0:1789123297.685998:0:15353:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f3406272800 10000000:01000000:1.0:1789123297.686002:0:15353:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789123297.686007:0:15353:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f3406272800 from 1 10000000:01000000:1.0:1789123297.686010:0:15353:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789123297.686043:0:15353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd33200/0x7e1648d68fc92ca7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123297.686051:0:15353:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f343bd33200/0x7e1648d68fc92ca7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123297.686061:0:15353:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f343bd33200/0x7e1648d68fc92ca7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123297.686083:0:15353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035aa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381273344:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789123297.686147:0:15353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123297.689202:0:15353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3405d37b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789123297.692262:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381273344 00000100:00100000:3.0:1789123297.692276:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381273344 00000100:00100000:3.0:1789123297.692335:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789123297.692346:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3404996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+15:15353:x1876031381273344:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789123297.692361:0:14665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123297.692379:0:14665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3402fbb800/0x7e1648d68fc92cae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc92ca7 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123297.692471:0:14665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3402fbb800/0x7e1648d68fc92cae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc92ca7 expref: 16 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123297.692482:0:14665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3402fbb800/0x7e1648d68fc92cae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc92ca7 expref: 16 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123297.692491:0:14665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbb800, rc 0) 00000100:00100000:3.0:1789123297.692725:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3404996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+16:15353:x1876031381273344:12345-0@lo:101:mount.lustre.0 Request processed in 380us (6577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123297.692733:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789123297.695815:0:15353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035aa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381273344:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789123297.696486:0:15353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f343bd33200/0x7e1648d68fc92ca7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92cae expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123297.696500:0:15353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f343bd33200/0x7e1648d68fc92ca7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc92cae expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789123297.698129:0:15353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1789123297.700035:0:15353:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789123297.700435:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789123297.700483:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789123297.700521:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789123297.700570:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789123297.700608:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789123297.700701:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789123297.700740:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789123297.700774:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789123297.700840:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789123297.700879:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789123297.700915:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789123297.700986:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789123297.701033:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789123297.701076:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789123297.701133:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789123297.701174:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789123297.701213:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789123297.701263:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789123297.701298:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789123297.701330:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789123297.703678:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789123297.703759:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789123297.703807:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789123297.704208:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789123297.704269:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1789123297.704304:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1789123297.704501:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1789123297.704559:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1789123297.704810:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1789123297.704820:0:15353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1789123297.705240:0:15353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035aa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381273472:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789123297.705298:0:15353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123297.705452:0:15353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3405d37b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789123297.707534:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381273472 00000100:00100000:2.0:1789123297.707545:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381273472 00000100:00100000:2.0:1789123297.707600:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789123297.707613:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3404997450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+16:15353:x1876031381273472:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789123297.708485:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3404997450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+16:15353:x1876031381273472:12345-0@lo:501:mount.lustre.0 Request processed in 872us (3182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123297.708497:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789123297.709504:0:15353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035aa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381273472:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789123297.709622:0:15353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035aa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381273600:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789123297.709698:0:15353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123297.709848:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381273600 00000100:00100000:0.0:1789123297.709854:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381273600 00000100:00100000:0.0:1789123297.709890:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789123297.709901:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3404994050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+16:15353:x1876031381273600:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789123297.710067:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3404994050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+16:15353:x1876031381273600:12345-0@lo:503:mount.lustre.0 Request processed in 168us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123297.710075:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789123297.710140:0:15353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3405d37b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789123297.710156:0:15353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035aa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381273600:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789123297.711012:0:15353:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789123297.711072:0:15353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035aa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381273728:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789123297.711116:0:15353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123297.711150:0:15353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3405d37b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789123297.713130:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381273728 00000100:00100000:0.0:1789123297.713142:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381273728 00000100:00100000:0.0:1789123297.713422:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789123297.713434:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3404996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+16:15353:x1876031381273728:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789123297.713710:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3404996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+16:15353:x1876031381273728:12345-0@lo:502:mount.lustre.0 Request processed in 278us (2592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123297.713718:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789123297.713940:0:15353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035aa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381273728:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789123297.714223:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789123297.714287:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789123297.714694:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789123297.714932:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789123297.714968:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789123297.715006:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789123297.715034:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789123297.715060:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789123297.715109:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789123297.715138:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789123297.715164:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789123297.715217:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789123297.715461:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789123297.715498:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789123297.715611:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789123297.715847:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789123297.715890:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789123297.715958:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789123297.716008:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789123297.716043:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789123297.716090:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789123297.716124:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789123297.716159:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789123297.716207:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789123297.716243:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1789123297.716275:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1789123297.716612:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1789123297.716751:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1789123297.716807:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1789123297.716864:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1789123297.716900:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1789123297.716931:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1789123297.716959:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1789123297.717008:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1789123297.717042:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1789123297.717093:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1789123297.717130:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1789123297.718003:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1789123297.718077:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1789123297.718116:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1789123297.718163:0:15353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035aa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381273856:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789123297.718247:0:15353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123297.718287:0:15353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3405d37b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789123297.718705:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381273856 00000100:00100000:0.0:1789123297.718714:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381273856 00000100:00100000:0.0:1789123297.718954:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789123297.718964:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3404995450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+16:15353:x1876031381273856:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789123297.719215:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3404995450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+16:15353:x1876031381273856:12345-0@lo:502:mount.lustre.0 Request processed in 252us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123297.719233:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789123297.719675:0:15353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035aa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381273856:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789123297.719779:0:15353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1789123297.719805:0:15353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1789123297.722227:0:15376:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789123297.722244:0:15376:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9f342d8a8000) 00000020:00000080:0.0:1789123297.722265:0:15376:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1789123297.722437:0:15376:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f3406272800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789123297.722441:0:15376:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f3406272800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789123297.722444:0:15376:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f3406272800 3 00010000:00080000:0.0:1789123297.722472:0:15376:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f3301f46800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.130@tcp at head 00010000:00010000:0.0:1789123297.726960:0:15376:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1789123297.727296:0:15376:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789123297.727342:0:15376:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789123297.727353:0:15376:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x7e1648d68fc92cbc 00000100:00080000:0.0:1789123297.727361:0:15376:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789123297.727367:0:15376:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f3301f46800 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:0.0:1789123297.727395:0:15376:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f34062dad00 x1876031381273984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789123297.727455:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1876031381273984:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789123297.727537:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123297.727575:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381273984 00000100:00100000:3.0:1789123297.727583:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381273984 00000100:00080000:0.0:1789123297.727597:0:15376:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789123297.727621:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:3.0:1789123297.727622:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789123297.727706:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789123297.727709:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789123297.727712:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789123297.727754:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876031381274112:0@lo:400:kworker.0 00000100:00100000:0.0:1789123297.727793:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123297.730059:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1876031381273984:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789123297.730092:0:14670:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 412 last 0 00000020:00000080:3.0:1789123297.730147:0:14670:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x7e1648d68fc92cc3 00000004:00100000:3.0:1789123297.730164:0:14670:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789123297.730200:0:14670:0:(import.c:65:import_set_state_nolock()) ffff9f343b9ad800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789123297.730357:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876031381273984:12345-0@lo:38:llog_process_th.0 Request processed in 304us (2819us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123297.730366:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789123297.730403:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381274112 00000100:00100000:3.0:1789123297.730409:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381274112 00000100:00100000:3.0:1789123297.730436:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789123297.730442:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876031381274112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123297.730492:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876031381274112:12345-0@lo:400:kworker.0 Request processed in 50us (2709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123297.730498:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789123297.730621:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f34062d8780 x1876031381274112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123297.730681:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876031381274112:0@lo:400:kworker.0 00000040:00080000:0.0:1789123297.731004:0:15376:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1789123297.731158:0:15353:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789123297.731188:0:15353:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789123297.731210:0:15353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd33200/0x7e1648d68fc92ca7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92cae expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123297.731222:0:15353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f343bd33200/0x7e1648d68fc92ca7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92cae expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789123297.731265:0:15353:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789123297.731267:0:15353:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789123297.731269:0:15353:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789123297.731271:0:15353:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789123297.731272:0:15353:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789123297.731274:0:15353:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789123297.731275:0:15353:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789123297.731277:0:15353:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789123297.731279:0:15353:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789123297.731282:0:15353:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1789123297.731285:0:15353:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789123297.731286:0:15353:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789123297.731288:0:15353:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789123297.731289:0:15353:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789123297.731290:0:15353:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789123297.731291:0:15353:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789123297.731293:0:15353:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789123297.731294:0:15353:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789123297.731295:0:15353:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789123297.731703:0:15353:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789123297.731721:0:15353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035ab0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381274240:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789123297.731773:0:15353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123297.731824:0:15353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3405d373c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789123297.731911:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381274240 00000100:00100000:0.0:1789123297.731917:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381274240 00000100:00100000:0.0:1789123297.731955:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789123297.731963:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3404994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+16:15353:x1876031381274240:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789123297.731986:0:14663:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789123297.732000:0:14663:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1789123297.735651:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f34062dad00 x1876031381273984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789123307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123297.735668:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789123297.735678:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1789123297.735687:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789123297.735692:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789123297.735696:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9f3301f46800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789123297.735703:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1876031381273984:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1789123297.773722:0:14663:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789123297.773762:0:14663:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789123297.773826:0:14686:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789123297.773831:0:14686:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789123297.773852:0:14686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f3402fbbc00/0x7e1648d68fc92cca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123297.773869:0:14686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f3402fbaa00/0x7e1648d68fc92c37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc92c30 expref: 16 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123297.773877:0:14686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f3402fbbc00/0x7e1648d68fc92cca lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123297.773915:0:14686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f3402fbaa00/0x7e1648d68fc92c37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc92c30 expref: 16 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123297.773930:0:14686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f3402fbaa00/0x7e1648d68fc92c37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc92c30 expref: 16 pid: 14665 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123297.773945:0:14686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062c83c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14686:1876031381274368:0@lo:104: 00000100:00100000:3.0:1789123297.774007:0:14686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123297.774054:0:14686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3418b81cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123297.775502:0:14654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381274368 00000100:00100000:1.0:1789123297.775512:0:14654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381274368 00000100:00100000:1.0:1789123297.775565:0:14654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789123297.775575:0:14654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39ef4522-e133-4b32-b80c-ca92d5b19344+3:14686:x1876031381274368:12345-0@lo:104: 00010000:00010000:1.0:1789123297.775590:0:14654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f3435b52c00/0x7e1648d68fc92c30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc92c37 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123297.775691:0:14654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789123297.775698:0:14654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39ef4522-e133-4b32-b80c-ca92d5b19344+3:14686:x1876031381274368:12345-0@lo:104: Request processed in 125us (1691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123297.775705:0:14654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789123297.775848:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789123297.775855:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f3435b52c00/0x7e1648d68fc92c30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc92c37 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123297.775863:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52c00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:3.0:1789123297.775867:0:14659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f3435b52c00/0x7e1648d68fc92c30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc92c37 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123297.775876:0:14659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f3435b52c00/0x7e1648d68fc92c30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc92c37 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789123297.775883:0:14659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f3435b52c00/0x7e1648d68fc92c30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc92c37 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789123297.775889:0:14659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789123297.775924:0:14659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f3435b52c00/0x7e1648d68fc92c30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc92c37 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123297.775930:0:14659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789123297.775949:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f3435b52c00/0x7e1648d68fc92c30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc92c37 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123297.775956:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f3435b52c00/0x7e1648d68fc92c30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc92c37 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123297.775973:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123297.775975:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123297.775976:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123297.775989:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062c8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39ef4522-e133-4b32-b80c-ca92d5b19344:3305:1876031381274496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789123297.776023:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123297.776089:0:14658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381274496 00000100:00100000:3.0:1789123297.776094:0:14658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381274496 00010000:00010000:3.0:1789123297.776113:0:14658:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f3402fbaa00/0x7e1648d68fc92c37 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc92c30 expref: 17 pid: 14665 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123297.776136:0:14658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789123297.776142:0:14658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062ca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39ef4522-e133-4b32-b80c-ca92d5b19344+17:3305:x1876031381274496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789123297.776158:0:14658:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123297.776164:0:14658:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f3402fbaa00/0x7e1648d68fc92c37 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc92c30 expref: 17 pid: 14665 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123297.776174:0:14658:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f3402fbaa00/0x7e1648d68fc92c37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc92c30 expref: 17 pid: 14665 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123297.776191:0:14658:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f3402fbbc00/0x7e1648d68fc92cca lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123297.776199:0:14658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3402fbbc00/0x7e1648d68fc92cca lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789123297.776212:0:14658:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005146249s 00010000:00010000:3.0:1789123297.776216:0:14658:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f3402fbbc00/0x7e1648d68fc92cca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123297.776224:0:14658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f3402fbbc00/0x7e1648d68fc92cca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123297.776231:0:14658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f3402fbbc00/0x7e1648d68fc92cca lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123297.776237:0:14658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f3402fbbc00/0x7e1648d68fc92cca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123297.776252:0:14658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbbc00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:3.0:1789123297.776256:0:14658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f3402fbbc00/0x7e1648d68fc92cca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123297.776263:0:14658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f3402fbbc00/0x7e1648d68fc92cca lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123297.776271:0:14658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f3402fbbc00/0x7e1648d68fc92cca lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123297.776280:0:14658:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789123297.776310:0:14658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062ca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39ef4522-e133-4b32-b80c-ca92d5b19344+17:3305:x1876031381274496:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123297.776316:0:14658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789123297.776355:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062c8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39ef4522-e133-4b32-b80c-ca92d5b19344:3305:1876031381274496:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789123297.776380:0:14686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3402fbaa00/0x7e1648d68fc92c37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc92c30 expref: 16 pid: 14665 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123297.776388:0:14686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062c83c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14686:1876031381274368:0@lo:104: 00010000:00010000:3.0:1789123297.776799:0:14686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f3402fbbc00/0x7e1648d68fc92cca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123297.776809:0:14686:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f3402fbbc00/0x7e1648d68fc92cca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123297.776816:0:14686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f3402fbbc00/0x7e1648d68fc92cca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123297.776834:0:14686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3402fbbc00/0x7e1648d68fc92cca lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123297.783832:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3404994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+15:15353:x1876031381274240:12345-0@lo:253:mount.lustre.0 Request processed in 51860us (52050us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123297.783847:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789123297.783953:0:15353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035ab0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:15353:1876031381274240:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789123297.783967:0:15353:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789123297.783971:0:15353:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789123297.783973:0:15353:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789123297.783974:0:15353:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789123297.783976:0:15353:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789123297.783977:0:15353:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789123297.783978:0:15353:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789123297.783980:0:15353:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789123297.783982:0:15353:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789123297.783983:0:15353:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789123297.783996:0:15353:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789123297.789514:0:15353:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789123297.790090:0:15353:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789123297.790259:0:15353:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789123297.790490:0:15353:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789123297.790828:0:15353:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:3.0:1789123297.790987:0:15353:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789123297.791867:0:15353:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1789123297.834465:0:15353:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789123297.834471:0:15353:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789123297.834503:0:15353:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789123297.834694:0:15353:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.130@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789123297.834708:0:15353:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789123297.834734:0:15353:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1789123298.436849:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789123299.020175:0:14668:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789123299.020183:0:14668:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f343fca3000 from 7 10000000:01000000:3.0:1789123299.020188:0:14668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789123299.020228:0:14668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3402fbaa00/0x7e1648d68fc92cd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123299.020239:0:14668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f3402fbaa00/0x7e1648d68fc92cd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123299.020248:0:14668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f3402fbaa00/0x7e1648d68fc92cd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123299.020271:0:14668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062c8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381274624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789123299.020332:0:14668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123299.020448:0:14668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3418697540 going to sleep for 11 seconds 00000100:00100000:2.0:1789123299.020547:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381274624 00000100:00100000:2.0:1789123299.020556:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381274624 00000100:00100000:2.0:1789123299.020615:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789123299.020660:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3436f5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+15:14668:x1876031381274624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789123299.020674:0:14666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123299.020690:0:14666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f342d80aa00/0x7e1648d68fc92cd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc92cd1 expref: -99 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123299.020738:0:14666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f342d80aa00/0x7e1648d68fc92cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc92cd1 expref: 16 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123299.020751:0:14666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f342d80aa00/0x7e1648d68fc92cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc92cd1 expref: 16 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123299.020760:0:14666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80aa00, rc 0) 00000100:00100000:2.0:1789123299.020963:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3436f5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+16:14668:x1876031381274624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 339us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123299.020970:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789123299.021134:0:14668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062c8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381274624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789123299.021149:0:14668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f3402fbaa00/0x7e1648d68fc92cd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92cd8 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123299.021165:0:14668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f3402fbaa00/0x7e1648d68fc92cd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc92cd8 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123299.021213:0:14668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062c8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381274752:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789123299.021247:0:14668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123299.021282:0:14668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3418697540 going to sleep for 11 seconds 00000100:00100000:2.0:1789123299.023062:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381274752 00000100:00100000:2.0:1789123299.023074:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381274752 00000100:00100000:2.0:1789123299.023131:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789123299.023144:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3436f5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+16:14668:x1876031381274752:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789123299.023169:0:14663:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789123299.023185:0:14663:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789123299.023188:0:14663:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789123299.023318:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3436f5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+16:14668:x1876031381274752:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 177us (2069us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123299.023326:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789123299.027374:0:14668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062c8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381274752:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789123299.027458:0:14668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789123299.027481:0:14668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3402fbaa00/0x7e1648d68fc92cd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92cd8 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123299.027493:0:14668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f3402fbaa00/0x7e1648d68fc92cd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92cd8 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123299.461241:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123300.484938:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123301.517051:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123302.535649:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789123302.918053:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789123302.918060:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789123302.918063:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789123302.918066:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789123302.918123:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39ef4522-e133-4b32-b80c-ca92d5b19344:3302:1876031381274880:0@lo:400:kworker.0 00000100:00100000:1.0:1789123302.918212:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123302.918269:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789123302.918276:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381275008:0@lo:400:kworker.0 00000100:00100000:1.0:1789123302.918316:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123302.918345:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381275136:0@lo:400:kworker.0 00000100:00100000:1.0:1789123302.918385:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123302.918437:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381274880 00000100:00100000:1.0:1789123302.918444:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381274880 00000100:00100000:1.0:1789123302.918490:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789123302.918500:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3436f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+16:3302:x1876031381274880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123302.918550:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3436f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+16:3302:x1876031381274880:12345-0@lo:400:kworker.0 Request processed in 52us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123302.918558:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789123302.918596:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381275008 00000100:00100000:1.0:1789123302.918599:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381275008 00000100:00100000:1.0:1789123302.918646:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381275136 00000100:00100000:1.0:1789123302.918650:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381275136 00000100:00100000:1.0:1789123302.918673:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789123302.918679:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f33035a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381275008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123302.918709:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f33035a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381275008:12345-0@lo:400:kworker.0 Request processed in 30us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123302.918715:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789123302.918727:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789123302.918732:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f33035a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381275136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123302.918777:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f33035a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381275136:12345-0@lo:400:kworker.0 Request processed in 45us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123302.918784:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789123302.918827:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f33035a9680 x1876031381275136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123302.918841:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381275136:0@lo:400:kworker.0 00010000:00080000:1.0:1789123302.918870:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f33035a8f00 x1876031381275008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123302.918886:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381275008:0@lo:400:kworker.0 00000100:00100000:1.0:1789123302.918896:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39ef4522-e133-4b32-b80c-ca92d5b19344:3302:1876031381274880:0@lo:400:kworker.0 00000100:00080000:3.0:1789123302.921547:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789123303.557435:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123304.585172:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789123304.705988:0:15722:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789123305.605844:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789123306.053471:0:14707:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789123306.628946:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123307.663017:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789123308.038515:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789123308.038522:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789123308.038525:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789123308.038528:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789123308.038573:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39ef4522-e133-4b32-b80c-ca92d5b19344:3305:1876031381275264:0@lo:400:kworker.0 00000100:00100000:1.0:1789123308.038680:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123308.038756:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381275392:0@lo:400:kworker.0 00000100:00100000:1.0:1789123308.038783:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123308.038802:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789123308.038819:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381275520:0@lo:400:kworker.0 00000100:00100000:1.0:1789123308.038840:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123308.038866:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381275264 00000100:00100000:1.0:1789123308.038872:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381275264 00000100:00100000:1.0:1789123308.038909:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789123308.038918:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3436f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+16:3305:x1876031381275264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123308.038965:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3436f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+16:3305:x1876031381275264:12345-0@lo:400:kworker.0 Request processed in 47us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123308.038971:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789123308.039009:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381275392 00000100:00100000:1.0:1789123308.039012:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381275392 00000100:00100000:1.0:1789123308.039047:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381275520 00000100:00100000:1.0:1789123308.039050:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381275520 00000100:00100000:1.0:1789123308.039070:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789123308.039075:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f33035a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381275392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123308.039109:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f33035a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381275392:12345-0@lo:400:kworker.0 Request processed in 33us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123308.039116:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789123308.039128:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789123308.039133:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f33035aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381275520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123308.039159:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f33035aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381275520:12345-0@lo:400:kworker.0 Request processed in 27us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123308.039164:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789123308.039206:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f33035a8b40 x1876031381275520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123308.039219:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381275520:0@lo:400:kworker.0 00010000:00080000:1.0:1789123308.039228:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f33035a9680 x1876031381275392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123308.039236:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381275392:0@lo:400:kworker.0 00000100:00100000:1.0:1789123308.039262:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39ef4522-e133-4b32-b80c-ca92d5b19344:3305:1876031381275264:0@lo:400:kworker.0 00000100:00080000:3.0:1789123308.040400:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789123308.680181:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123309.700810:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123310.020777:0:3301:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789123294/real 1789123294] req@ffff9f34062db840 x1876031381271424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789123309 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123310.020807:0:3301:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f34062db840 x1876031381271424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789123309 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123310.020838:0:3301:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789123294/real 1789123294] req@ffff9f34062d9680 x1876031381271552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789123309 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789123310.020851:0:3301:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f34062d9680 x1876031381271552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789123309 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789123310.020870:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9f33012b6000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789123310.020906:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789123310.020910:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876031381271424:0@lo:8:kworker.0 00000100:00080000:1.0:1789123310.020916:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9f343b0d7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789123310.020920:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789123310.020923:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876031381271552:0@lo:8:kworker.0 00000100:00080000:2.0:1789123310.021130:0:13284:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789123310.021135:0:13284:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789123310.021138:0:13284:0:(import.c:65:import_set_state_nolock()) ffff9f33012b6000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789123310.021149:0:13284:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 409 00000100:00080000:2.0:1789123310.021154:0:13284:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789123310.021160:0:13284:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f33012b6000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:2.0:1789123310.021180:0:13284:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f343c30b840 x1876031381275776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789123310.021197:0:13284:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789123310.021200:0:13284:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789123310.021202:0:13284:0:(import.c:65:import_set_state_nolock()) ffff9f343b0d7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789123310.021206:0:13284:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 409 00000100:00080000:2.0:1789123310.021208:0:13284:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789123310.021211:0:13284:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f343b0d7000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:2.0:1789123310.021223:0:13284:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f343c309a40 x1876031381275904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789123310.021265:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c30b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876031381275776:0@lo:8:kworker.0 00000100:00100000:2.0:1789123310.021329:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123310.021370:0:15355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381275776 00000100:00100000:3.0:1789123310.021378:0:15355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381275776 00000100:00100000:2.0:1789123310.021384:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c309a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876031381275904:0@lo:8:kworker.0 00000100:00100000:3.0:1789123310.021411:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789123310.021417:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123310.021422:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c308780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1876031381275776:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789123310.021450:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c30a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381276160:0@lo:400:kworker.0 00010000:00080000:3.0:1789123310.021451:0:15355:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 424 last 0 00000100:00100000:2.0:1789123310.021485:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1789123310.021489:0:15355:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7e1648d68fc92cdf 00002000:00100000:3.0:1789123310.021504:0:15355:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9f33028d4800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398a ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789123310.021509:0:15355:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789123310.021518:0:15355:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1789123310.021522:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381276160 00000100:00100000:2.0:1789123310.021528:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381276160 00000100:00100000:2.0:1789123310.021571:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789123310.021579:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c308f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381276160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123310.021667:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c308f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381276160:12345-0@lo:400:kworker.0 Request processed in 88us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123310.021685:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1789123310.021708:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789123310.021747:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f343c30a1c0 x1876031381276160/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123310.021760:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c30a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381276160:0@lo:400:kworker.0 00000100:00100000:0.0:1789123310.021841:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c30a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876031381276032:0@lo:400:kworker.0 00000100:00100000:0.0:1789123310.021869:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123310.021907:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789123310.021913:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c30b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39ef4522-e133-4b32-b80c-ca92d5b19344:3305:1876031381275648:0@lo:400:kworker.0 00000100:00100000:0.0:1789123310.021937:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123310.021970:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381275648 00000100:00100000:0.0:1789123310.021974:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381275648 00000100:00100000:0.0:1789123310.022000:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789123310.022007:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3436f5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+16:3305:x1876031381275648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123310.022052:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3436f5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+16:3305:x1876031381275648:12345-0@lo:400:kworker.0 Request processed in 45us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123310.022059:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789123310.022095:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c30b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39ef4522-e133-4b32-b80c-ca92d5b19344:3305:1876031381275648:0@lo:400:kworker.0 00000100:00100000:1.0:1789123310.022223:0:15356:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789123310.022231:0:15356:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789123310.022243:0:15357:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789123310.022250:0:15357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381275904 00000100:00100000:1.0:1789123310.022254:0:15357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381275904 00000100:00100000:1.0:1789123310.022522:0:15956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789123310.022528:0:15956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3301:x1876031381275904:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789123310.022541:0:15956:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789123310.022594:0:15956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3301:x1876031381275904:12345-0@lo:8:kworker.0 Request processed in 64us (1177us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789123310.022600:0:15956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789123310.022671:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9f343b0d7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789123310.022676:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789123310.022679:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c309a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876031381275904:0@lo:8:kworker.0 00000100:00100000:2.0:1789123310.023046:0:14671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381276032 00000100:00100000:2.0:1789123310.023052:0:14671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381276032 00000100:00100000:2.0:1789123310.023082:0:14671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789123310.023089:0:14671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876031381276032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123310.023133:0:14671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876031381276032:12345-0@lo:400:kworker.0 Request processed in 45us (1263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123310.023139:0:14671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789123310.023198:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f343c30a940 x1876031381276032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123310.023209:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c30a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876031381276032:0@lo:400:kworker.0 00002000:00080000:3.0:1789123310.025545:0:15355:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789123310.025580:0:15355:0:(import.c:65:import_set_state_nolock()) ffff9f33028d0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789123310.027042:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c308780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1876031381275776:12345-0@lo:8:kworker.0 Request processed in 5615us (5707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123310.027057:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789123310.034099:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f343c30b840 x1876031381275776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789123330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123310.034113:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789123310.034123:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789123310.034132:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789123310.034137:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789123310.034141:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9f33012b6000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789123310.034203:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789123310.034209:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c30b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876031381275776:0@lo:8:kworker.0 00000100:00100000:0.0:1789123310.034416:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381276288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789123310.034472:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1789123310.034529:0:14693:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1789123310.034549:0:14693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035a8b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14693:1876031381276416:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789123310.034598:0:14693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123310.034623:0:14693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410bcd840 going to sleep for 11 seconds 00000100:00100000:1.0:1789123310.034677:0:15357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381276416 00000100:00100000:1.0:1789123310.034682:0:15357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381276416 00000100:00100000:1.0:1789123310.034742:0:15357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789123310.034751:0:15357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f33035a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14693:x1876031381276416:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789123310.034893:0:15358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381276288 00000100:00100000:2.0:1789123310.034897:0:15358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381276288 00000100:00100000:2.0:1789123310.034939:0:15358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000004:00080000:3.0:1789123310.034940:0:14692:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1789123310.034946:0:15358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1876031381276288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789123310.034969:0:15358:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000004:00080000:3.0:1789123310.035209:0:14692:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 424365580238ns, next at 0ns, rc = 0 00000100:00080000:3.0:1789123310.038945:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1789123310.039749:0:15357:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789123310.039759:0:15357:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1789123310.039764:0:15357:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00100000:2.0:1789123310.039982:0:15358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1876031381276288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5031us (5504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123310.039994:0:15358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789123310.046064:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f33035a9680 x1876031381276288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123310.046112:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381276288:0@lo:13:osp-pre-0-0.0 00002000:00010000:1.0:1789123310.058458:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123310.058471:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008190e111/0x7e1648d68fc92ce6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.058487:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789123310.058492:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123310.058498:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008190e111/0x7e1648d68fc92ce6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.058515:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008190e111/0x7e1648d68fc92ce6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.058524:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008190e111/0x7e1648d68fc92ce6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.058530:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008190e111/0x7e1648d68fc92ce6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.058557:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789123310.058790:0:14660:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789123310.058799:0:14660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008190e111/0x7e1648d68fc92ce6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.058809:0:14660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33000 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:2.0:1789123310.058814:0:14660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008190e111/0x7e1648d68fc92ce6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.058830:0:14660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008190e111/0x7e1648d68fc92ce6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.058849:0:14660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008190e111/0x7e1648d68fc92ce6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.058858:0:14660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008190e111/0x7e1648d68fc92ce6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.058948:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123310.058951:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123310.058954:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789123310.059669:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123310.059683:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4a1cb0/0x7e1648d68fc92ced lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.059694:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789123310.059698:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123310.059703:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4a1cb0/0x7e1648d68fc92ced lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.059714:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb4a1cb0/0x7e1648d68fc92ced lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.059733:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4a1cb0/0x7e1648d68fc92ced lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.059740:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4a1cb0/0x7e1648d68fc92ced lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.059755:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789123310.060235:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789123310.060245:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb4a1cb0/0x7e1648d68fc92ced lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123310.060258:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32000 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:3.0:1789123310.060262:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4a1cb0/0x7e1648d68fc92ced lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123310.060270:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4a1cb0/0x7e1648d68fc92ced lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123310.060289:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb4a1cb0/0x7e1648d68fc92ced lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123310.060299:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb4a1cb0/0x7e1648d68fc92ced lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123310.060321:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123310.060323:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123310.060329:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789123310.060460:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123310.060467:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b59247f/0x7e1648d68fc92cf4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.060476:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789123310.060480:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123310.060484:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b59247f/0x7e1648d68fc92cf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.060494:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b59247f/0x7e1648d68fc92cf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.060508:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b59247f/0x7e1648d68fc92cf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.060516:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b59247f/0x7e1648d68fc92cf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.060538:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789123310.060664:0:14660:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789123310.060671:0:14660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b59247f/0x7e1648d68fc92cf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123310.060680:0:14660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32c00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:0.0:1789123310.060684:0:14660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b59247f/0x7e1648d68fc92cf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123310.060693:0:14660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b59247f/0x7e1648d68fc92cf4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123310.060708:0:14660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b59247f/0x7e1648d68fc92cf4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123310.060728:0:14660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b59247f/0x7e1648d68fc92cf4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123310.060746:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123310.060749:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123310.060751:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789123310.062207:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123310.062217:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039ed4e8e/0x7e1648d68fc92cfb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.062230:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789123310.062235:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123310.062240:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039ed4e8e/0x7e1648d68fc92cfb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.062251:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039ed4e8e/0x7e1648d68fc92cfb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.062260:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039ed4e8e/0x7e1648d68fc92cfb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.062267:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039ed4e8e/0x7e1648d68fc92cfb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.062516:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789123310.063102:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123310.063109:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000833834ab/0x7e1648d68fc92d02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.063120:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789123310.063124:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123310.063128:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000833834ab/0x7e1648d68fc92d02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.063139:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000833834ab/0x7e1648d68fc92d02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.063148:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000833834ab/0x7e1648d68fc92d02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.063155:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000833834ab/0x7e1648d68fc92d02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.066351:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789123310.066364:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039ed4e8e/0x7e1648d68fc92cfb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.066378:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33400 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:2.0:1789123310.066382:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039ed4e8e/0x7e1648d68fc92cfb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.066392:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039ed4e8e/0x7e1648d68fc92cfb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.066413:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039ed4e8e/0x7e1648d68fc92cfb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.066437:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039ed4e8e/0x7e1648d68fc92cfb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.066457:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789123310.066461:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000833834ab/0x7e1648d68fc92d02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.066466:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33c00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:2.0:1789123310.066468:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000833834ab/0x7e1648d68fc92d02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.066475:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000833834ab/0x7e1648d68fc92d02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.066485:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000833834ab/0x7e1648d68fc92d02 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.066491:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123310.066493:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123310.066495:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123310.068355:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789123310.068369:0:15357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000833834ab/0x7e1648d68fc92d02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.068410:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789123310.070267:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123310.070286:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bef5449b/0x7e1648d68fc92d09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.070301:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789123310.070306:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123310.070312:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bef5449b/0x7e1648d68fc92d09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.070326:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bef5449b/0x7e1648d68fc92d09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.070337:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bef5449b/0x7e1648d68fc92d09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.070346:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bef5449b/0x7e1648d68fc92d09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.070370:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789123310.070384:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789123310.070390:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bef5449b/0x7e1648d68fc92d09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.070398:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32800 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123310.070403:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bef5449b/0x7e1648d68fc92d09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.070413:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bef5449b/0x7e1648d68fc92d09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.070437:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bef5449b/0x7e1648d68fc92d09 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.070446:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bef5449b/0x7e1648d68fc92d09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.070464:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123310.070467:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123310.070469:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789123310.072366:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123310.072379:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8b80ee9/0x7e1648d68fc92d10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.072393:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789123310.072398:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123310.072403:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8b80ee9/0x7e1648d68fc92d10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.072416:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8b80ee9/0x7e1648d68fc92d10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.072427:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8b80ee9/0x7e1648d68fc92d10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.072434:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8b80ee9/0x7e1648d68fc92d10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.072514:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789123310.073254:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123310.073262:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b9cca8d/0x7e1648d68fc92d17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.073271:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789123310.073275:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123310.073280:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b9cca8d/0x7e1648d68fc92d17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.073291:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b9cca8d/0x7e1648d68fc92d17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.073300:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b9cca8d/0x7e1648d68fc92d17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.073308:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b9cca8d/0x7e1648d68fc92d17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.073361:0:14660:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789123310.073370:0:14660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8b80ee9/0x7e1648d68fc92d10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.073379:0:14660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32a00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:2.0:1789123310.073390:0:14660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8b80ee9/0x7e1648d68fc92d10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.073400:0:14660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8b80ee9/0x7e1648d68fc92d10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.073417:0:14660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8b80ee9/0x7e1648d68fc92d10 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.073425:0:14660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8b80ee9/0x7e1648d68fc92d10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.073442:0:14660:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789123310.073446:0:14660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b9cca8d/0x7e1648d68fc92d17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.073453:0:14660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32200 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:2.0:1789123310.073457:0:14660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b9cca8d/0x7e1648d68fc92d17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.073465:0:14660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b9cca8d/0x7e1648d68fc92d17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.073474:0:14660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b9cca8d/0x7e1648d68fc92d17 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.073481:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123310.073487:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123310.073489:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123310.073555:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789123310.073560:0:15357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b9cca8d/0x7e1648d68fc92d17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789123310.074294:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123310.074301:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008190e111/0x7e1648d68fc92d1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.074317:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789123310.074320:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123310.074325:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008190e111/0x7e1648d68fc92d1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.074335:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008190e111/0x7e1648d68fc92d1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.074343:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008190e111/0x7e1648d68fc92d1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.074350:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008190e111/0x7e1648d68fc92d1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.074515:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789123310.074521:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008190e111/0x7e1648d68fc92d1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.074529:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33000 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:2.0:1789123310.074533:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008190e111/0x7e1648d68fc92d1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.074541:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008190e111/0x7e1648d68fc92d1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.074554:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008190e111/0x7e1648d68fc92d1e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.074562:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123310.074564:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123310.074565:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123310.074727:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789123310.074732:0:15357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008190e111/0x7e1648d68fc92d1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789123310.075183:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123310.075190:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4a1cb0/0x7e1648d68fc92d25 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.075200:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789123310.075203:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123310.075208:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4a1cb0/0x7e1648d68fc92d25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.075229:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb4a1cb0/0x7e1648d68fc92d25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.075238:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4a1cb0/0x7e1648d68fc92d25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.075247:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4a1cb0/0x7e1648d68fc92d25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.078888:0:14660:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789123310.078902:0:14660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb4a1cb0/0x7e1648d68fc92d25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.078917:0:14660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32000 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:2.0:1789123310.078921:0:14660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4a1cb0/0x7e1648d68fc92d25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.078933:0:14660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4a1cb0/0x7e1648d68fc92d25 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.078965:0:14660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb4a1cb0/0x7e1648d68fc92d25 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.079210:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123310.079213:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123310.079215:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123310.079646:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789123310.079654:0:15357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb4a1cb0/0x7e1648d68fc92d25 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.080018:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789123310.080619:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123310.080648:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b59247f/0x7e1648d68fc92d2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.080661:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789123310.080666:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123310.080672:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b59247f/0x7e1648d68fc92d2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.080684:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b59247f/0x7e1648d68fc92d2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.080705:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b59247f/0x7e1648d68fc92d2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.080713:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b59247f/0x7e1648d68fc92d2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.080742:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789123310.080752:0:14660:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789123310.080757:0:14660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b59247f/0x7e1648d68fc92d2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.080764:0:14660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd32c00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123310.080768:0:14660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b59247f/0x7e1648d68fc92d2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.080796:0:14660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b59247f/0x7e1648d68fc92d2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.080812:0:14660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b59247f/0x7e1648d68fc92d2c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.080820:0:14660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b59247f/0x7e1648d68fc92d2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.080836:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123310.080844:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123310.080846:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789123310.081261:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123310.081267:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048cb2a07/0x7e1648d68fc92d33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.081275:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789123310.081278:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123310.081282:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048cb2a07/0x7e1648d68fc92d33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.081291:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048cb2a07/0x7e1648d68fc92d33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.081298:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048cb2a07/0x7e1648d68fc92d33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.081305:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048cb2a07/0x7e1648d68fc92d33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.081322:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789123310.081332:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789123310.081336:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048cb2a07/0x7e1648d68fc92d33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.081343:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401514600 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123310.081347:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048cb2a07/0x7e1648d68fc92d33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.081368:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048cb2a07/0x7e1648d68fc92d33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.081380:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048cb2a07/0x7e1648d68fc92d33 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.081388:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048cb2a07/0x7e1648d68fc92d33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.081403:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123310.081405:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123310.081406:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789123310.082129:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123310.082136:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000577c8bfc/0x7e1648d68fc92d3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.082146:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789123310.082149:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123310.082154:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000577c8bfc/0x7e1648d68fc92d3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.082164:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000577c8bfc/0x7e1648d68fc92d3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.082172:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000577c8bfc/0x7e1648d68fc92d3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.082186:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000577c8bfc/0x7e1648d68fc92d3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.082201:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789123310.082210:0:14660:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789123310.082214:0:14660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000577c8bfc/0x7e1648d68fc92d3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.082221:0:14660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401514c00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123310.082224:0:14660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000577c8bfc/0x7e1648d68fc92d3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.082233:0:14660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000577c8bfc/0x7e1648d68fc92d3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.082245:0:14660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000577c8bfc/0x7e1648d68fc92d3a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.082252:0:14660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000577c8bfc/0x7e1648d68fc92d3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.082267:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123310.082268:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123310.082271:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789123310.082746:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123310.082761:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af13bbaa/0x7e1648d68fc92d41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.082770:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789123310.082773:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123310.082778:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af13bbaa/0x7e1648d68fc92d41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.084600:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af13bbaa/0x7e1648d68fc92d41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.084620:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af13bbaa/0x7e1648d68fc92d41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.084639:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af13bbaa/0x7e1648d68fc92d41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.084660:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789123310.084676:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789123310.084681:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af13bbaa/0x7e1648d68fc92d41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.084688:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401514a00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123310.084693:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af13bbaa/0x7e1648d68fc92d41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.084701:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af13bbaa/0x7e1648d68fc92d41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.084741:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af13bbaa/0x7e1648d68fc92d41 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.084749:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af13bbaa/0x7e1648d68fc92d41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.084768:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123310.084770:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123310.084939:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789123310.086492:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123310.086504:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000280ddb25/0x7e1648d68fc92d48 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.086517:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789123310.086522:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123310.086528:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000280ddb25/0x7e1648d68fc92d48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.086542:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000280ddb25/0x7e1648d68fc92d48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.086551:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000280ddb25/0x7e1648d68fc92d48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.086559:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000280ddb25/0x7e1648d68fc92d48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.086589:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789123310.086602:0:14660:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789123310.086607:0:14660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000280ddb25/0x7e1648d68fc92d48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.086615:0:14660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401515600 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123310.086620:0:14660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000280ddb25/0x7e1648d68fc92d48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.086649:0:14660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000280ddb25/0x7e1648d68fc92d48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.086664:0:14660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000280ddb25/0x7e1648d68fc92d48 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.086673:0:14660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000280ddb25/0x7e1648d68fc92d48 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.086690:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123310.086692:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123310.086694:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789123310.092195:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123310.092208:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd02f78f/0x7e1648d68fc92d4f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.092225:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789123310.092238:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123310.092246:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd02f78f/0x7e1648d68fc92d4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.092261:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd02f78f/0x7e1648d68fc92d4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.092272:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd02f78f/0x7e1648d68fc92d4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.092281:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd02f78f/0x7e1648d68fc92d4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.092300:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789123310.092817:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789123310.092826:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd02f78f/0x7e1648d68fc92d4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123310.092844:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401515200 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:0.0:1789123310.093054:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd02f78f/0x7e1648d68fc92d4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123310.093066:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd02f78f/0x7e1648d68fc92d4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123310.093085:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd02f78f/0x7e1648d68fc92d4f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123310.093093:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd02f78f/0x7e1648d68fc92d4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123310.093113:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123310.093116:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123310.093118:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789123310.093331:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123310.093338:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1543c31/0x7e1648d68fc92d56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.093348:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789123310.093352:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123310.093358:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1543c31/0x7e1648d68fc92d56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.093369:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1543c31/0x7e1648d68fc92d56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.093379:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1543c31/0x7e1648d68fc92d56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.093393:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1543c31/0x7e1648d68fc92d56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.093420:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789123310.093940:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123310.093947:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae8d9a59/0x7e1648d68fc92d5d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.093956:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789123310.093959:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123310.093963:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae8d9a59/0x7e1648d68fc92d5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.093973:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae8d9a59/0x7e1648d68fc92d5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.093981:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae8d9a59/0x7e1648d68fc92d5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.093988:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae8d9a59/0x7e1648d68fc92d5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.094007:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789123310.094478:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123310.094486:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065589c12/0x7e1648d68fc92d64 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.094501:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789123310.094504:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123310.094509:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065589c12/0x7e1648d68fc92d64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.094519:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065589c12/0x7e1648d68fc92d64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.094529:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065589c12/0x7e1648d68fc92d64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.094537:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065589c12/0x7e1648d68fc92d64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.094547:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1789123310.094958:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123310.094964:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a799fe24/0x7e1648d68fc92d6b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.094972:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789123310.094974:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123310.094979:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a799fe24/0x7e1648d68fc92d6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.094986:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a799fe24/0x7e1648d68fc92d6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.095004:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a799fe24/0x7e1648d68fc92d6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.095011:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a799fe24/0x7e1648d68fc92d6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.095019:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1789123310.095370:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123310.095376:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000311c4589/0x7e1648d68fc92d72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.095385:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789123310.095388:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123310.095393:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000311c4589/0x7e1648d68fc92d72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.095402:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000311c4589/0x7e1648d68fc92d72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.095411:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000311c4589/0x7e1648d68fc92d72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.095419:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000311c4589/0x7e1648d68fc92d72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.095438:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1789123310.095854:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123310.095860:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065590729/0x7e1648d68fc92d79 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.095869:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789123310.095872:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123310.095876:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065590729/0x7e1648d68fc92d79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.095886:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065590729/0x7e1648d68fc92d79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.095895:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065590729/0x7e1648d68fc92d79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.095901:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065590729/0x7e1648d68fc92d79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.095908:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1789123310.096258:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789123310.096266:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1543c31/0x7e1648d68fc92d56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096275:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401514800 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:2.0:1789123310.096280:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1543c31/0x7e1648d68fc92d56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096290:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1543c31/0x7e1648d68fc92d56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096308:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1543c31/0x7e1648d68fc92d56 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096316:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1543c31/0x7e1648d68fc92d56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096333:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789123310.096337:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae8d9a59/0x7e1648d68fc92d5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096350:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401515e00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:2.0:1789123310.096354:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae8d9a59/0x7e1648d68fc92d5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096362:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae8d9a59/0x7e1648d68fc92d5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096373:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae8d9a59/0x7e1648d68fc92d5d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096381:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae8d9a59/0x7e1648d68fc92d5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096394:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789123310.096398:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065589c12/0x7e1648d68fc92d64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096404:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401515000 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:2.0:1789123310.096407:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065589c12/0x7e1648d68fc92d64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096415:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065589c12/0x7e1648d68fc92d64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096424:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065589c12/0x7e1648d68fc92d64 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096436:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065589c12/0x7e1648d68fc92d64 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096448:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789123310.096452:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a799fe24/0x7e1648d68fc92d6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096458:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401514000 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:2.0:1789123310.096462:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a799fe24/0x7e1648d68fc92d6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096471:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a799fe24/0x7e1648d68fc92d6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096481:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a799fe24/0x7e1648d68fc92d6b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096489:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a799fe24/0x7e1648d68fc92d6b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096499:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789123310.096502:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000311c4589/0x7e1648d68fc92d72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096509:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401515a00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:2.0:1789123310.096516:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000311c4589/0x7e1648d68fc92d72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096525:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000311c4589/0x7e1648d68fc92d72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096535:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000311c4589/0x7e1648d68fc92d72 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096543:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000311c4589/0x7e1648d68fc92d72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096555:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789123310.096558:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065590729/0x7e1648d68fc92d79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096565:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401514e00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:2.0:1789123310.096569:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065590729/0x7e1648d68fc92d79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096577:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065590729/0x7e1648d68fc92d79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096586:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065590729/0x7e1648d68fc92d79 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096594:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065590729/0x7e1648d68fc92d79 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123310.096611:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123310.096612:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123310.096614:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123310.098785:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789123310.106457:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123310.106470:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005df24f1c/0x7e1648d68fc92d80 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.106486:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789123310.106497:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123310.106504:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005df24f1c/0x7e1648d68fc92d80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.106520:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005df24f1c/0x7e1648d68fc92d80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.106530:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005df24f1c/0x7e1648d68fc92d80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.106538:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005df24f1c/0x7e1648d68fc92d80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.106557:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789123310.106569:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789123310.106574:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005df24f1c/0x7e1648d68fc92d80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.106582:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3303949a00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123310.106586:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005df24f1c/0x7e1648d68fc92d80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.106595:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005df24f1c/0x7e1648d68fc92d80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.106618:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005df24f1c/0x7e1648d68fc92d80 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.106660:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005df24f1c/0x7e1648d68fc92d80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.106677:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123310.106679:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123310.106681:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789123310.107943:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123310.107952:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032a80e10/0x7e1648d68fc92d87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.107964:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789123310.107968:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123310.107974:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032a80e10/0x7e1648d68fc92d87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.107985:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032a80e10/0x7e1648d68fc92d87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.107993:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032a80e10/0x7e1648d68fc92d87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.108001:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032a80e10/0x7e1648d68fc92d87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.108018:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789123310.108029:0:14660:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789123310.108040:0:14660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032a80e10/0x7e1648d68fc92d87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.108048:0:14660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3303949e00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123310.108051:0:14660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032a80e10/0x7e1648d68fc92d87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.108060:0:14660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032a80e10/0x7e1648d68fc92d87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.108072:0:14660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032a80e10/0x7e1648d68fc92d87 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.108080:0:14660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032a80e10/0x7e1648d68fc92d87 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.108092:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123310.108094:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123310.108096:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789123310.108465:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123310.108471:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000524327df/0x7e1648d68fc92d8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.108480:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=424s v=(0 0) 00010000:00010000:1.0:1789123310.108484:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123310.108488:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000524327df/0x7e1648d68fc92d8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.108509:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000524327df/0x7e1648d68fc92d8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.108518:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000524327df/0x7e1648d68fc92d8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.108526:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000524327df/0x7e1648d68fc92d8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.108542:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789123310.108550:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789123310.108554:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000524327df/0x7e1648d68fc92d8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.108562:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3303949200 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123310.108565:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000524327df/0x7e1648d68fc92d8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.108574:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000524327df/0x7e1648d68fc92d8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.108585:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000524327df/0x7e1648d68fc92d8e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.108593:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000524327df/0x7e1648d68fc92d8e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789123310.110282:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789123310.110293:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038f0f86b/0x7e1648d68fc92d95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123310.110306:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1789123310.110310:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123310.110315:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038f0f86b/0x7e1648d68fc92d95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123310.110327:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038f0f86b/0x7e1648d68fc92d95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123310.110350:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038f0f86b/0x7e1648d68fc92d95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123310.110358:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038f0f86b/0x7e1648d68fc92d95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123310.110374:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789123310.110747:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789123310.110753:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b5b201/0x7e1648d68fc92d9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123310.110761:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1789123310.110764:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123310.110769:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005b5b201/0x7e1648d68fc92d9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123310.110778:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005b5b201/0x7e1648d68fc92d9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123310.110786:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b5b201/0x7e1648d68fc92d9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123310.110793:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005b5b201/0x7e1648d68fc92d9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123310.110810:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789123310.111144:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789123310.111149:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ce561f3/0x7e1648d68fc92da3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123310.111158:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1789123310.111161:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123310.111165:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ce561f3/0x7e1648d68fc92da3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123310.111174:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ce561f3/0x7e1648d68fc92da3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123310.111181:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ce561f3/0x7e1648d68fc92da3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123310.111189:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ce561f3/0x7e1648d68fc92da3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123310.111196:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:0.0:1789123310.111331:0:15357:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1789123310.111414:0:15357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f33035a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14693:x1876031381276416:12345-0@lo:5:osp-pre-0-0.0 Request processed in 76662us (76813us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123310.111426:0:15357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789123310.112094:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789123310.112102:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038f0f86b/0x7e1648d68fc92d95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.112112:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53600 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123310.112116:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038f0f86b/0x7e1648d68fc92d95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.112127:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038f0f86b/0x7e1648d68fc92d95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.112144:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038f0f86b/0x7e1648d68fc92d95 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.112151:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038f0f86b/0x7e1648d68fc92d95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.112165:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789123310.112168:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005b5b201/0x7e1648d68fc92d9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.112174:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52800 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123310.112177:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b5b201/0x7e1648d68fc92d9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.112199:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b5b201/0x7e1648d68fc92d9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.112208:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005b5b201/0x7e1648d68fc92d9c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.112215:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005b5b201/0x7e1648d68fc92d9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.112226:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789123310.112229:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ce561f3/0x7e1648d68fc92da3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.112235:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52400 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123310.112238:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ce561f3/0x7e1648d68fc92da3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.112245:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ce561f3/0x7e1648d68fc92da3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.112253:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ce561f3/0x7e1648d68fc92da3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.112259:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ce561f3/0x7e1648d68fc92da3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123310.112278:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123310.112280:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123310.112282:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123310.113659:0:14693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035a8b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14693:1876031381276416:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789123310.113676:0:14693:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1789123310.113733:0:14693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035a8b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14693:1876031381276544:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789123310.113944:0:14693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123310.113995:0:14693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410bcd840 going to sleep for 11 seconds 00000100:00100000:1.0:1789123310.114013:0:15956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381276544 00000100:00100000:1.0:1789123310.114018:0:15956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381276544 00000100:00100000:1.0:1789123310.114065:0:15956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789123310.114075:0:15956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f33035ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14693:x1876031381276544:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789123310.114119:0:15956:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000004:00080000:2.0:1789123310.116696:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1789123310.118727:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123310.122157:0:15956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f33035ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14693:x1876031381276544:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8077us (8207us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789123310.122170:0:15956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789123310.122287:0:14693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035a8b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14693:1876031381276544:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789123310.122302:0:14693:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1789123310.734056:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123311.748775:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789123311.835220:0:16074:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789123311.835224:0:16074:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1789123311.835337:0:16074:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f3408403800 00000020:01000004:1.0:1789123311.835350:0:16074:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789123311.835362:0:16074:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1789123311.835375:0:16074:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9f3436568000) 00000020:00000080:1.0:1789123311.835389:0:16074:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789123311.848583:0:16074:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789123311.848986:0:16074:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789123311.849779:0:16074:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789123311.850850:0:16074:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1789123311.851060:0:16074:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1789123311.851395:0:16074:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 293: rc = 0 00100000:10000000:0.0:1789123311.851492:0:16074:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 293: rc = 0 00100000:10000000:0.0:1789123311.851585:0:16074:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 293: rc = 0 00100000:10000000:0.0:1789123311.852106:0:16074:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 654: rc = 0 00100000:10000000:0.0:1789123311.852343:0:16074:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 654: rc = 0 00100000:10000000:0.0:1789123311.852795:0:16074:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 654: rc = 0 00100000:10000000:0.0:1789123311.853939:0:16074:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 654: rc = 0 00100000:10000000:0.0:1789123311.854188:0:16074:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 654: rc = 0 00100000:10000000:0.0:1789123311.854408:0:16074:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 654: rc = 0 00000020:00000080:0.0:1789123311.855032:0:16074:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789123311.855043:0:16074:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789123311.855053:0:16074:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7e1648d68fc92db1 00000020:01000004:0.0:1789123311.855060:0:16074:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1789123311.855078:0:16074:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.130@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789123311.855081:0:16074:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789123311.855087:0:16074:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789123311.855105:0:16074:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1789123311.855254:0:16074:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.130@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789123311.863441:0:16074:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.130@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789123311.863480:0:16074:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.130@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1789123311.863487:0:16074:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789123311.863489:0:16074:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789123311.863490:0:16074:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789123311.863491:0:16074:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789123311.863493:0:16074:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789123311.863494:0:16074:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789123311.863495:0:16074:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789123311.863497:0:16074:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789123311.863498:0:16074:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789123311.863501:0:16074:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1789123311.863503:0:16074:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789123311.863504:0:16074:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789123311.863505:0:16074:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789123311.863506:0:16074:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789123311.863507:0:16074:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789123311.863508:0:16074:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789123311.863509:0:16074:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789123311.863510:0:16074:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789123311.863511:0:16074:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789123311.863533:0:16074:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789123311.863551:0:16074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381276672:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789123311.863761:0:16074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123311.863857:0:16074:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410bcd000 going to sleep for 11 seconds 00000100:00100000:2.0:1789123311.863921:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381276672 00000100:00100000:2.0:1789123311.863927:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381276672 00000100:00100000:2.0:1789123311.864003:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789123311.864012:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3436f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+16:16074:x1876031381276672:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789123311.864037:0:14665:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789123311.864040:0:14665:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789123311.864044:0:14665:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789123311.875919:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3436f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+16:16074:x1876031381276672:12345-0@lo:253:mount.lustre.0 Request processed in 11900us (12150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123311.875932:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789123311.876060:0:16074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381276672:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789123311.876074:0:16074:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789123311.876078:0:16074:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789123311.876080:0:16074:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789123311.876081:0:16074:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789123311.876082:0:16074:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789123311.876083:0:16074:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789123311.876084:0:16074:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789123311.876085:0:16074:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789123311.876087:0:16074:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789123311.876088:0:16074:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789123311.876107:0:16074:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f3408403800 from lustre-OST0001 10000000:01000000:1.0:1789123311.876131:0:16074:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789123311.876133:0:16074:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789123311.876155:0:16074:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f34066aced8 local copy 00010000:00010000:1.0:1789123311.876164:0:16074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd32600/0x7e1648d68fc92b57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92b5e expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123311.876392:0:16074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381276800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789123311.876427:0:16074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123311.876512:0:16074:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f343c34f540 going to sleep for 11 seconds 00000100:00100000:0.0:1789123311.876552:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381276800 00000100:00100000:0.0:1789123311.876564:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381276800 00000100:00100000:0.0:1789123311.876657:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789123311.876668:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3436f5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+16:16074:x1876031381276800:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789123311.876893:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3436f5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+16:16074:x1876031381276800:12345-0@lo:501:mount.lustre.0 Request processed in 227us (464us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789123311.876900:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789123311.877009:0:16074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381276800:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789123311.877023:0:16074:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789123311.877182:0:16074:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789123311.877190:0:16074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f343bd32600/0x7e1648d68fc92b57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92b5e expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123311.877198:0:16074:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f343bd32600/0x7e1648d68fc92b57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92b5e expref: -99 pid: 14653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123311.877220:0:16074:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f3408403800 10000000:01000000:2.0:1789123311.877224:0:16074:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789123311.877229:0:16074:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789123311.877232:0:16074:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789123311.877236:0:16074:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789123311.877238:0:16074:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789123311.877262:0:16074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f342d80ae00/0x7e1648d68fc92db8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123311.877274:0:16074:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f342d80ae00/0x7e1648d68fc92db8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123311.877283:0:16074:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f342d80ae00/0x7e1648d68fc92db8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123311.877295:0:16074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c309680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381276928:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789123311.877324:0:16074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123311.877523:0:16074:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410bce0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789123311.877681:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381276928 00000100:00100000:1.0:1789123311.877686:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381276928 00000100:00100000:1.0:1789123311.877722:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789123311.877729:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3436f5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+16:16074:x1876031381276928:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789123311.877739:0:14663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123311.877750:0:14663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3303948c00/0x7e1648d68fc92dbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc92db8 expref: -99 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123311.877772:0:14663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3303948c00/0x7e1648d68fc92dbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc92db8 expref: 17 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123311.877782:0:14663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3303948c00/0x7e1648d68fc92dbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc92db8 expref: 17 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123311.877790:0:14663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3303948c00, rc 0) 00000100:00100000:1.0:1789123311.877821:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3436f5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+17:16074:x1876031381276928:12345-0@lo:101:mount.lustre.0 Request processed in 92us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123311.877827:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789123311.877900:0:16074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c309680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381276928:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789123311.877914:0:16074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f342d80ae00/0x7e1648d68fc92db8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92dbf expref: -99 pid: 16074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123311.877923:0:16074:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f342d80ae00/0x7e1648d68fc92db8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc92dbf expref: -99 pid: 16074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789123311.878447:0:16074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789123311.879149:0:16074:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789123311.879367:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789123311.879410:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789123311.879443:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789123311.879485:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789123311.879517:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789123311.879548:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789123311.879612:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789123311.879620:0:16074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789123311.879732:0:16074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c309680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381277056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789123311.879782:0:16074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123311.879830:0:16074:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410bced80 going to sleep for 11 seconds 00000100:00100000:1.0:1789123311.879989:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381277056 00000100:00100000:1.0:1789123311.879994:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381277056 00000100:00100000:1.0:1789123311.880022:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789123311.880030:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3436f5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+17:16074:x1876031381277056:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789123311.880314:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3436f5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+17:16074:x1876031381277056:12345-0@lo:501:mount.lustre.0 Request processed in 284us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123311.880321:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789123311.880409:0:16074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c309680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381277056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789123311.880442:0:16074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c309680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381277184:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789123311.880484:0:16074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123311.880550:0:16074:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410bced80 going to sleep for 11 seconds 00000100:00100000:0.0:1789123311.880666:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381277184 00000100:00100000:0.0:1789123311.880671:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381277184 00000100:00100000:3.0:1789123311.880826:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789123311.880835:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3436f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+17:16074:x1876031381277184:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789123311.881182:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3436f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+17:16074:x1876031381277184:12345-0@lo:503:mount.lustre.0 Request processed in 348us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123311.881190:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789123311.881263:0:16074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c309680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381277184:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789123311.881946:0:16074:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789123311.882004:0:16074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c309680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381277312:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789123311.882047:0:16074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123311.882189:0:16074:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410bced80 going to sleep for 11 seconds 00000100:00100000:1.0:1789123311.882225:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381277312 00000100:00100000:1.0:1789123311.882230:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381277312 00000100:00100000:3.0:1789123311.882271:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789123311.882280:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3436f5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+17:16074:x1876031381277312:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789123311.882477:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3436f5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+17:16074:x1876031381277312:12345-0@lo:502:mount.lustre.0 Request processed in 199us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123311.882485:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789123311.882565:0:16074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c309680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381277312:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789123311.882840:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789123311.882883:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789123311.882913:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789123311.882955:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789123311.882990:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789123311.883018:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789123311.883061:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789123311.883094:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789123311.883151:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1789123311.883180:0:16074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c309680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381277440:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789123311.883220:0:16074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123311.883296:0:16074:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410bced80 going to sleep for 11 seconds 00000100:00100000:0.0:1789123311.883345:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381277440 00000100:00100000:0.0:1789123311.883350:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381277440 00000100:00100000:0.0:1789123311.883377:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789123311.883385:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3436f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+17:16074:x1876031381277440:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789123311.883577:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3436f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+17:16074:x1876031381277440:12345-0@lo:502:mount.lustre.0 Request processed in 191us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123311.883584:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789123311.883952:0:16074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c309680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381277440:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789123311.884020:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1789123311.884028:0:16074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1789123311.884817:0:16076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789123311.884823:0:16076:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1789123311.884829:0:16076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789123311.884831:0:16076:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789123311.884835:0:16076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789123311.884849:0:16076:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9f342d8a9a48) 00000020:00000080:0.0:1789123311.884867:0:16076:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789123311.884871:0:16076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789123311.884917:0:16076:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f3408403800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789123311.884924:0:16076:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789123311.884929:0:16076:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7e1648d68fc92dcd 00010000:00010000:0.0:1789123311.888045:0:16076:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1789123311.888383:0:16076:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1789123311.890119:0:16076:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:0.0:1789123311.892274:0:16076:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789123311.892285:0:16076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789123311.892292:0:16076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789123311.892294:0:16076:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789123311.892298:0:16076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789123311.892302:0:16076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789123311.892303:0:16076:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789123311.892306:0:16076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789123311.892307:0:16076:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789123311.892309:0:16076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789123311.892311:0:16076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789123311.892312:0:16076:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789123311.892314:0:16076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789123311.892316:0:16076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789123311.892317:0:16076:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789123311.892320:0:16076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789123311.892353:0:16076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789123311.892355:0:16076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789123311.892356:0:16076:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789123311.892360:0:16076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1789123311.895912:0:16074:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1789123311.895953:0:16074:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789123311.895976:0:16074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f342d80ae00/0x7e1648d68fc92db8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92dbf expref: -99 pid: 16074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123311.895988:0:16074:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f342d80ae00/0x7e1648d68fc92db8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92dbf expref: -99 pid: 16074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123311.895996:0:16074:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f3408403800 from 1 10000000:01000000:2.0:1789123311.895998:0:16074:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789123311.896032:0:16074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f342d80a200/0x7e1648d68fc92dd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123311.896039:0:16074:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f342d80a200/0x7e1648d68fc92dd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123311.896048:0:16074:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f342d80a200/0x7e1648d68fc92dd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123311.896070:0:16074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c309680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381277568:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789123311.896133:0:16074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123311.896172:0:16074:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410bced80 going to sleep for 11 seconds 00000100:00100000:1.0:1789123311.896592:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381277568 00000100:00100000:1.0:1789123311.896610:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381277568 00000100:00100000:1.0:1789123311.896685:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789123311.896694:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3436f5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+17:16074:x1876031381277568:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789123311.896716:0:14663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123311.896729:0:14663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3303948e00/0x7e1648d68fc92ddb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc92dd4 expref: -99 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123311.896750:0:14663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3303948e00/0x7e1648d68fc92ddb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc92dd4 expref: 18 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123311.896760:0:14663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3303948e00/0x7e1648d68fc92ddb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc92dd4 expref: 18 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123311.896767:0:14663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3303948e00, rc 0) 00000100:00100000:1.0:1789123311.896809:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3436f5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+18:16074:x1876031381277568:12345-0@lo:101:mount.lustre.0 Request processed in 116us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123311.896815:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789123311.896976:0:16074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c309680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381277568:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789123311.896990:0:16074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f342d80a200/0x7e1648d68fc92dd4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92ddb expref: -99 pid: 16074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123311.896999:0:16074:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f342d80a200/0x7e1648d68fc92dd4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc92ddb expref: -99 pid: 16074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789123311.897518:0:16074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789123311.898055:0:16074:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789123311.898264:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789123311.898308:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789123311.898362:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789123311.898369:0:16074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789123311.898435:0:16074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062ca580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381277696:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789123311.898485:0:16074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123311.898519:0:16074:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340622f600 going to sleep for 11 seconds 00000100:00100000:0.0:1789123311.898694:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381277696 00000100:00100000:0.0:1789123311.898701:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381277696 00000100:00100000:0.0:1789123311.898746:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789123311.898754:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3436f5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+18:16074:x1876031381277696:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789123311.898937:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3436f5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+18:16074:x1876031381277696:12345-0@lo:501:mount.lustre.0 Request processed in 184us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123311.898944:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789123311.899332:0:16074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062ca580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381277696:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789123311.899361:0:16074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062ca580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381277824:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789123311.899402:0:16074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123311.899428:0:16074:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340622f600 going to sleep for 11 seconds 00000100:00100000:0.0:1789123311.899467:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381277824 00000100:00100000:0.0:1789123311.899471:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381277824 00000100:00100000:0.0:1789123311.899534:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789123311.899541:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3436f5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+18:16074:x1876031381277824:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789123311.899832:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3436f5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+18:16074:x1876031381277824:12345-0@lo:503:mount.lustre.0 Request processed in 290us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123311.899838:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789123311.901683:0:16074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062ca580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381277824:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789123311.902267:0:16074:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789123311.902335:0:16074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062ca580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381277952:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789123311.902402:0:16074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123311.902782:0:16074:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340622f600 going to sleep for 11 seconds 00000100:00100000:1.0:1789123311.902850:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381277952 00000100:00100000:1.0:1789123311.902856:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381277952 00000100:00100000:1.0:1789123311.902890:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789123311.902898:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427b23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+18:16074:x1876031381277952:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789123311.903086:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427b23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+18:16074:x1876031381277952:12345-0@lo:502:mount.lustre.0 Request processed in 188us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123311.903100:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789123311.903199:0:16074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062ca580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381277952:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789123311.903417:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789123311.903461:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789123311.903499:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789123311.903528:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789123311.903572:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789123311.903733:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789123311.903773:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789123311.903802:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:3.0:1789123311.903840:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:3.0:1789123311.903869:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:3.0:1789123311.903905:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10256 00000100:00100000:3.0:1789123311.903935:0:16074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062ca580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381278080:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789123311.903981:0:16074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123311.904012:0:16074:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340622f600 going to sleep for 11 seconds 00000100:00100000:1.0:1789123311.904071:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381278080 00000100:00100000:1.0:1789123311.904076:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381278080 00000100:00100000:1.0:1789123311.904099:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789123311.904105:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427b23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+18:16074:x1876031381278080:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789123311.904249:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427b23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+18:16074:x1876031381278080:12345-0@lo:502:mount.lustre.0 Request processed in 143us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123311.904257:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789123311.904332:0:16074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062ca580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381278080:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789123311.904390:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10480 00000040:00080000:3.0:1789123311.904398:0:16074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789123311.905194:0:16080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789123311.905203:0:16080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123311.905205:0:16080:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789123311.905210:0:16080:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f3408403800 00000020:00000080:3.0:1789123311.905213:0:16080:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789123311.905219:0:16080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789123311.905221:0:16080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123311.905222:0:16080:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789123311.905225:0:16080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789123311.905227:0:16080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123311.905228:0:16080:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789123311.905231:0:16080:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f3408403800 00000020:00000080:3.0:1789123311.905233:0:16080:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789123311.905453:0:16080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789123311.905458:0:16080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123311.905459:0:16080:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789123311.905462:0:16080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789123311.905464:0:16080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123311.905466:0:16080:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789123311.905469:0:16080:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f3408403800 00000020:00000080:3.0:1789123311.905472:0:16080:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789123311.906754:0:16080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789123311.906761:0:16080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123311.906762:0:16080:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789123311.906766:0:16080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789123311.906768:0:16080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123311.906770:0:16080:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789123311.906773:0:16080:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f3408403800 00000020:00000080:3.0:1789123311.906781:0:16080:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789123311.906844:0:16080:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789123311.906847:0:16080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789123311.906849:0:16080:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789123311.906851:0:16080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1789123311.906988:0:16074:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789123311.907010:0:16074:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789123311.907033:0:16074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f342d80a200/0x7e1648d68fc92dd4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92ddb expref: -99 pid: 16074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123311.907045:0:16074:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f342d80a200/0x7e1648d68fc92dd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92ddb expref: -99 pid: 16074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789123311.907083:0:16074:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789123311.907086:0:16074:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f3408403800 10000000:01000000:1.0:1789123311.907089:0:16074:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f3408403800 10000000:01000000:1.0:1789123311.907093:0:16074:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789123311.907097:0:16074:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f3408403800 from 1 10000000:01000000:1.0:1789123311.907099:0:16074:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789123311.907130:0:16074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3303948800/0x7e1648d68fc92de2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123311.907136:0:16074:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f3303948800/0x7e1648d68fc92de2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123311.907145:0:16074:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f3303948800/0x7e1648d68fc92de2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123311.907172:0:16074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035a9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381278208:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789123311.907229:0:16074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123311.907727:0:16074:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410bcd000 going to sleep for 11 seconds 00000100:00100000:2.0:1789123311.911969:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381278208 00000100:00100000:2.0:1789123311.911981:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381278208 00000100:00100000:2.0:1789123311.912062:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789123311.912071:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427b20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+18:16074:x1876031381278208:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789123311.912086:0:14663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123311.912102:0:14663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f342d80ac00/0x7e1648d68fc92de9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc92de2 expref: -99 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123311.912138:0:14663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f342d80ac00/0x7e1648d68fc92de9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc92de2 expref: 19 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123311.912147:0:14663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f342d80ac00/0x7e1648d68fc92de9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc92de2 expref: 19 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123311.912156:0:14663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80ac00, rc 0) 00000100:00100000:2.0:1789123311.912804:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427b20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+19:16074:x1876031381278208:12345-0@lo:101:mount.lustre.0 Request processed in 732us (5572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123311.912811:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789123311.917818:0:16074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035a9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381278208:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789123311.917847:0:16074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f3303948800/0x7e1648d68fc92de2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92de9 expref: -99 pid: 16074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123311.917860:0:16074:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f3303948800/0x7e1648d68fc92de2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc92de9 expref: -99 pid: 16074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789123311.918419:0:16074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1789123311.920013:0:16074:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789123311.920267:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789123311.920310:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789123311.920338:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789123311.920378:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789123311.920415:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789123311.920481:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789123311.920512:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789123311.920538:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789123311.920593:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789123311.920660:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789123311.920697:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789123311.920765:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789123311.920799:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789123311.920831:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789123311.920879:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789123311.920912:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789123311.920944:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789123311.921212:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789123311.921260:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789123311.921296:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789123311.921347:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789123311.921401:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789123311.921439:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789123311.921491:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789123311.921530:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1789123311.921566:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1789123311.924669:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1789123311.924984:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1789123311.925019:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1789123311.925067:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1789123311.925097:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1789123311.925125:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1789123311.925152:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1789123311.925191:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1789123311.925222:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1789123311.925270:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1789123311.925309:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1789123311.925402:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1789123311.925410:0:16074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1789123311.925506:0:16074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c3092c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381278336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789123311.925573:0:16074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123311.925653:0:16074:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410bce840 going to sleep for 11 seconds 00000100:00100000:3.0:1789123311.925798:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381278336 00000100:00100000:3.0:1789123311.925805:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381278336 00000100:00100000:3.0:1789123311.925844:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789123311.925853:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427b22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+19:16074:x1876031381278336:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789123311.926069:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427b22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+19:16074:x1876031381278336:12345-0@lo:501:mount.lustre.0 Request processed in 216us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123311.926077:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789123311.926347:0:16074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c3092c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381278336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789123311.926384:0:16074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c3092c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381278464:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789123311.926432:0:16074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123311.926459:0:16074:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410bce840 going to sleep for 11 seconds 00000100:00100000:0.0:1789123311.926472:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381278464 00000100:00100000:0.0:1789123311.926476:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381278464 00000100:00100000:0.0:1789123311.926509:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789123311.926516:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427b23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+19:16074:x1876031381278464:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789123311.928619:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427b23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+19:16074:x1876031381278464:12345-0@lo:503:mount.lustre.0 Request processed in 2095us (2177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123311.928647:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789123311.928735:0:16074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c3092c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381278464:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789123311.930957:0:16074:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789123311.931042:0:16074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381278592:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789123311.931110:0:16074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123311.931153:0:16074:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408c6f300 going to sleep for 11 seconds 00000100:00100000:2.0:1789123311.931664:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381278592 00000100:00100000:2.0:1789123311.931670:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381278592 00000100:00100000:2.0:1789123311.931717:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789123311.931725:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427b21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+19:16074:x1876031381278592:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789123311.931936:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427b21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+19:16074:x1876031381278592:12345-0@lo:502:mount.lustre.0 Request processed in 211us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123311.931943:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789123311.932335:0:16074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381278592:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789123311.932758:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789123311.932826:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789123311.932860:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789123311.932907:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789123311.932943:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789123311.932990:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789123311.933025:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789123311.933056:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789123311.933103:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789123311.933138:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789123311.933170:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789123311.934344:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789123311.934529:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789123311.934561:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789123311.934730:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789123311.934781:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789123311.934814:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789123311.934880:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789123311.934919:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789123311.934954:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789123311.935007:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789123311.935062:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789123311.935101:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789123311.935151:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789123311.935189:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1789123311.936363:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1789123311.936533:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1789123311.936658:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1789123311.936701:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1789123311.936766:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1789123311.936801:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1789123311.936829:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1789123311.936856:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1789123311.936936:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1789123311.936972:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1789123311.937017:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1789123311.937051:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1789123311.937083:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1789123311.937143:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1789123311.937182:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1789123311.938174:0:16074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381278720:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789123311.938327:0:16074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123311.938494:0:16074:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3408c6f300 going to sleep for 11 seconds 00000100:00100000:2.0:1789123311.938608:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381278720 00000100:00100000:2.0:1789123311.938616:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381278720 00000100:00100000:2.0:1789123311.938681:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789123311.938689:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427b22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+19:16074:x1876031381278720:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789123311.938925:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427b22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+19:16074:x1876031381278720:12345-0@lo:502:mount.lustre.0 Request processed in 236us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123311.938932:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789123311.939329:0:16074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381278720:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789123311.939487:0:16074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1789123311.939501:0:16074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1789123311.941426:0:16086:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789123311.941455:0:16086:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9f330350b490) 00000020:00000080:0.0:1789123311.941475:0:16086:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1789123311.941559:0:16086:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f3408403800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789123311.941563:0:16086:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f3408403800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789123311.941566:0:16086:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f3408403800 3 00010000:00080000:0.0:1789123311.941595:0:16086:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f3303511000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.130@tcp at head 00010000:00010000:1.0:1789123311.944429:0:16086:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1789123311.944646:0:16086:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789123311.944681:0:16086:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789123311.944693:0:16086:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x7e1648d68fc92df7 00000100:00080000:1.0:1789123311.944702:0:16086:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789123311.944717:0:16086:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f3303511000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:1.0:1789123311.944759:0:16086:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f33035a8780 x1876031381278848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789123311.944778:0:16086:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789123311.945004:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789123311.945008:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789123311.945011:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f343b0d7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789123311.945015:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 424 00000100:00080000:3.0:1789123311.945019:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789123311.945023:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f343b0d7000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:3.0:1789123311.945034:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f34062cad00 x1876031381279104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789123311.945076:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381279360:0@lo:400:kworker.0 00000100:00100000:3.0:1789123311.945137:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123311.945277:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381278976:0@lo:400:kworker.0 00000100:00100000:1.0:1789123311.945307:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123311.945319:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1876031381278848:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789123311.945330:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789123311.945336:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876031381279232:0@lo:400:kworker.0 00000100:00100000:0.0:1789123311.945348:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123311.945394:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876031381279104:0@lo:8:kworker.0 00000100:00100000:0.0:1789123311.945416:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123311.945449:0:15356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381278976 00000100:00100000:0.0:1789123311.945454:0:15356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381278976 00000040:00080000:1.0:1789123311.945462:0:16086:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:0.0:1789123311.945485:0:15356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381279104 00000100:00100000:0.0:1789123311.945487:0:15356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381279104 00000100:00100000:0.0:1789123311.945504:0:15356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789123311.945512:0:15356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f33035ab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1876031381278976:12345-0@lo:400:kworker.0 00000020:01000000:1.0:1789123311.945545:0:16074:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 00000100:00100000:0.0:1789123311.945552:0:15356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f33035ab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1876031381278976:12345-0@lo:400:kworker.0 Request processed in 42us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123311.945559:0:15356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789123311.945572:0:15356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789123311.945576:0:15356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062db840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3301:x1876031381279104:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789123311.945617:0:15356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062db840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3301:x1876031381279104:12345-0@lo:8:kworker.0 Request processed in 39us (200us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789123311.945661:0:15356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789123311.945702:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1789123311.945704:0:16074:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789123311.945729:0:16074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3303948800/0x7e1648d68fc92de2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92de9 expref: -99 pid: 16074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123311.945739:0:16074:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f3303948800/0x7e1648d68fc92de2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92de9 expref: -99 pid: 16074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123311.945747:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381278976:0@lo:400:kworker.0 00000100:00100000:0.0:1789123311.945767:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381279360 00000100:00100000:0.0:1789123311.945771:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381279360 00000020:01000004:1.0:1789123311.945786:0:16074:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000100:00100000:0.0:1789123311.945788:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381278848 00000100:00100000:0.0:1789123311.945790:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381278848 00000020:01000004:1.0:1789123311.945791:0:16074:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789123311.945792:0:16074:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789123311.945794:0:16074:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789123311.945795:0:16074:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789123311.945796:0:16074:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789123311.945797:0:16074:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000100:00100000:0.0:1789123311.945797:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381279232 00000020:01000004:1.0:1789123311.945799:0:16074:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000100:00100000:0.0:1789123311.945799:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381279232 00000020:01000004:1.0:1789123311.945800:0:16074:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789123311.945804:0:16074:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1789123311.945806:0:16074:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789123311.945807:0:16074:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789123311.945808:0:16074:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789123311.945809:0:16074:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00100000:0.0:1789123311.945809:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000020:01000004:1.0:1789123311.945810:0:16074:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789123311.945811:0:16074:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789123311.945812:0:16074:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789123311.945813:0:16074:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789123311.945814:0:16074:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1789123311.945814:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381279360:12345-0@lo:400:kworker.0 10000000:01000000:1.0:1789123311.945828:0:16074:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789123311.945837:0:16074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035aad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381279488:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789123311.945851:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876031381279360:12345-0@lo:400:kworker.0 Request processed in 36us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123311.945857:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789123311.945869:0:16074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123311.945869:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789123311.945874:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876031381279232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123311.945885:0:16074:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f34011caa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789123311.945902:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876031381279232:12345-0@lo:400:kworker.0 Request processed in 28us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123311.945908:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789123311.945921:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789123311.945925:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1876031381278848:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789123311.945939:0:14670:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:0.0:1789123311.945968:0:14670:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x7e1648d68fc92dfe 00000004:00100000:0.0:1789123311.945981:0:14670:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789123311.946007:0:14670:0:(import.c:65:import_set_state_nolock()) ffff9f3303510800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789123311.946037:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876031381278848:12345-0@lo:38:llog_process_th.0 Request processed in 110us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123311.946048:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789123311.946078:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f34062c9a40 x1876031381279360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123311.946087:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876031381279360:0@lo:400:kworker.0 00010000:00080000:0.0:1789123311.946108:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f33035a8780 x1876031381278848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789123321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123311.946117:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789123311.946122:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1789123311.946128:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789123311.946132:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789123311.946134:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9f3303511000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789123311.946138:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1876031381278848:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789123311.946147:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789123311.946150:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9f343b0d7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789123311.946153:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789123311.946155:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876031381279104:0@lo:8:kworker.0 00010000:00080000:0.0:1789123311.946175:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f34062cb0c0 x1876031381279232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789123311.946183:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876031381279232:0@lo:400:kworker.0 00000100:00100000:3.0:1789123311.946683:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381279488 00000100:00100000:3.0:1789123311.946696:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381279488 00000100:00100000:3.0:1789123311.946738:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789123311.946744:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427b23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+19:16074:x1876031381279488:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789123311.946764:0:14665:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789123311.946774:0:14665:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789123311.968127:0:14665:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789123311.968147:0:14665:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789123311.968193:0:14686:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789123311.968198:0:14686:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789123311.968218:0:14686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f3435b52200/0x7e1648d68fc92e05 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123311.968252:0:14686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f342d80aa00/0x7e1648d68fc92cd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc92cd1 expref: 19 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123311.968261:0:14686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f3435b52200/0x7e1648d68fc92e05 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123311.968296:0:14686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f342d80aa00/0x7e1648d68fc92cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc92cd1 expref: 19 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123311.968309:0:14686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f342d80aa00/0x7e1648d68fc92cd8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc92cd1 expref: 19 pid: 14666 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123311.968322:0:14686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062dad00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14686:1876031381279616:0@lo:104: 00000100:00100000:0.0:1789123311.968381:0:14686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123311.968426:0:14686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f341851c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789123311.968820:0:14655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381279616 00000100:00100000:3.0:1789123311.968828:0:14655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381279616 00000100:00100000:3.0:1789123311.968862:0:14655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789123311.968870:0:14655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39ef4522-e133-4b32-b80c-ca92d5b19344+3:14686:x1876031381279616:12345-0@lo:104: 00010000:00010000:3.0:1789123311.968882:0:14655:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f3402fbaa00/0x7e1648d68fc92cd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc92cd8 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123311.968931:0:14655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789123311.968936:0:14655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39ef4522-e133-4b32-b80c-ca92d5b19344+3:14686:x1876031381279616:12345-0@lo:104: Request processed in 68us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123311.968942:0:14655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789123311.969044:0:14686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062dad00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14686:1876031381279616:0@lo:104: 00010000:00010000:0.0:1789123311.969062:0:14686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f3435b52200/0x7e1648d68fc92e05 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123311.969165:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789123311.969172:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f3402fbaa00/0x7e1648d68fc92cd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc92cd8 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123311.969179:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbaa00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:1.0:1789123311.969183:0:14659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f3402fbaa00/0x7e1648d68fc92cd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc92cd8 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123311.969191:0:14659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f3402fbaa00/0x7e1648d68fc92cd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc92cd8 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789123311.969198:0:14659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f3402fbaa00/0x7e1648d68fc92cd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc92cd8 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789123311.969216:0:14659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789123311.969250:0:14659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f3402fbaa00/0x7e1648d68fc92cd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc92cd8 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123311.969256:0:14659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789123311.969274:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f3402fbaa00/0x7e1648d68fc92cd1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc92cd8 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123311.969281:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f3402fbaa00/0x7e1648d68fc92cd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc92cd8 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123311.969297:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123311.969298:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123311.969300:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123311.969377:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39ef4522-e133-4b32-b80c-ca92d5b19344:3303:1876031381279744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789123311.969409:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123311.969552:0:14658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381279744 00000100:00100000:3.0:1789123311.969556:0:14658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381279744 00010000:00010000:3.0:1789123311.969575:0:14658:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f342d80aa00/0x7e1648d68fc92cd8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc92cd1 expref: 20 pid: 14666 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123311.969612:0:14658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789123311.969620:0:14658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062dad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39ef4522-e133-4b32-b80c-ca92d5b19344+20:3303:x1876031381279744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789123311.969651:0:14658:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123311.969656:0:14658:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f342d80aa00/0x7e1648d68fc92cd8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc92cd1 expref: 20 pid: 14666 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123311.969676:0:14658:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f342d80aa00/0x7e1648d68fc92cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc92cd1 expref: 20 pid: 14666 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123311.969689:0:14658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f342d80aa00/0x7e1648d68fc92cd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc92cd1 expref: 20 pid: 14666 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123311.969700:0:14658:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f3435b52200/0x7e1648d68fc92e05 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123311.969716:0:14658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3435b52200/0x7e1648d68fc92e05 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789123311.969729:0:14658:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005146249s 00010000:00010000:3.0:1789123311.969733:0:14658:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f3435b52200/0x7e1648d68fc92e05 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123311.969740:0:14658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f3435b52200/0x7e1648d68fc92e05 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123311.969746:0:14658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f3435b52200/0x7e1648d68fc92e05 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123311.969752:0:14658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f3435b52200/0x7e1648d68fc92e05 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123311.969756:0:14658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52200 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:3.0:1789123311.969759:0:14658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f3435b52200/0x7e1648d68fc92e05 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123311.969765:0:14658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f3435b52200/0x7e1648d68fc92e05 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123311.969783:0:14658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f3435b52200/0x7e1648d68fc92e05 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123311.969791:0:14658:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789123311.969818:0:14658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062dad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39ef4522-e133-4b32-b80c-ca92d5b19344+19:3303:x1876031381279744:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123311.969825:0:14658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789123311.970372:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39ef4522-e133-4b32-b80c-ca92d5b19344:3303:1876031381279744:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789123311.970397:0:14686:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f3435b52200/0x7e1648d68fc92e05 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123311.970404:0:14686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f3435b52200/0x7e1648d68fc92e05 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123311.970421:0:14686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3435b52200/0x7e1648d68fc92e05 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123311.973737:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427b23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+18:16074:x1876031381279488:12345-0@lo:253:mount.lustre.0 Request processed in 26986us (27860us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123311.973749:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789123311.973876:0:16074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035aad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39ef4522-e133-4b32-b80c-ca92d5b19344:16074:1876031381279488:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789123311.973891:0:16074:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789123311.973894:0:16074:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789123311.973895:0:16074:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789123311.973896:0:16074:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789123311.973898:0:16074:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789123311.973899:0:16074:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789123311.973900:0:16074:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789123311.973901:0:16074:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789123311.973903:0:16074:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789123311.973904:0:16074:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789123311.973915:0:16074:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789123311.977552:0:16074:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789123311.977932:0:16074:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789123311.978075:0:16074:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789123311.978211:0:16074:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789123311.978400:0:16074:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:1.0:1789123311.978565:0:16074:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789123311.979411:0:16074:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1789123312.021539:0:16074:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789123312.021546:0:16074:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789123312.021809:0:16074:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789123312.021860:0:16074:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.130@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789123312.021877:0:16074:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789123312.021903:0:16074:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789123312.772926:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789123313.094855:0:14668:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789123313.094862:0:14668:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f343fca3000 from 8 10000000:01000000:1.0:1789123313.094867:0:14668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789123313.094912:0:14668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3303948000/0x7e1648d68fc92e0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123313.094924:0:14668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f3303948000/0x7e1648d68fc92e0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123313.094935:0:14668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f3303948000/0x7e1648d68fc92e0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123313.094958:0:14668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035aad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381279872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789123313.095024:0:14668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123313.095073:0:14668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3418ab2000 going to sleep for 11 seconds 00000100:00100000:2.0:1789123313.095147:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381279872 00000100:00100000:2.0:1789123313.095154:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381279872 00000100:00100000:2.0:1789123313.095203:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789123313.095212:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427b21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+18:14668:x1876031381279872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789123313.095224:0:14666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123313.095237:0:14666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f342d80b400/0x7e1648d68fc92e13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc92e0c expref: -99 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123313.095274:0:14666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f342d80b400/0x7e1648d68fc92e13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc92e0c expref: 19 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123313.095283:0:14666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f342d80b400/0x7e1648d68fc92e13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc92e0c expref: 19 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123313.095292:0:14666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80b400, rc 0) 00000100:00100000:2.0:1789123313.095342:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427b21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+19:14668:x1876031381279872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123313.095349:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789123313.095434:0:14668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035aad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381279872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789123313.095451:0:14668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f3303948000/0x7e1648d68fc92e0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92e13 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123313.095459:0:14668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f3303948000/0x7e1648d68fc92e0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc92e13 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123313.095521:0:14668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381280000:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789123313.095554:0:14668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123313.095575:0:14668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3418274d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789123313.095679:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381280000 00000100:00100000:2.0:1789123313.095684:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381280000 00000100:00100000:2.0:1789123313.095720:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789123313.095727:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427b21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+19:14668:x1876031381280000:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789123313.095739:0:14665:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789123313.095754:0:14665:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789123313.095757:0:14665:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1789123313.095824:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427b21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+19:14668:x1876031381280000:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 97us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123313.095831:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789123313.095902:0:14668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381280000:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789123313.095957:0:14668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789123313.095964:0:14668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3303948000/0x7e1648d68fc92e0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92e13 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123313.095973:0:14668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f3303948000/0x7e1648d68fc92e0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92e13 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789123313.256009:0:6710:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1789123313.256071:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1789123313.797017:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123314.834430:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123315.206106:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381280128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789123315.206208:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123315.206406:0:15358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381280128 00000100:00100000:0.0:1789123315.206416:0:15358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381280128 00000100:00100000:0.0:1789123315.206493:0:15358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789123315.206505:0:15358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f33035ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381280128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789123315.206549:0:15358:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789123315.206614:0:15358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f33035ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381280128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123315.206623:0:15358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789123315.206748:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789123315.206785:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381280128:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789123315.206847:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789123315.847869:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789123316.299794:0:14707:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789123316.869376:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789123317.254130:0:13284:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789123317.254137:0:13284:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789123317.254140:0:13284:0:(import.c:65:import_set_state_nolock()) ffff9f343b0d7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789123317.254151:0:13284:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f343b0d7000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:3.0:1789123317.254178:0:13284:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f34062c9e00 x1876031381280512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789123317.254235:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39ef4522-e133-4b32-b80c-ca92d5b19344:3305:1876031381280256:0@lo:400:kworker.0 00000100:00100000:3.0:1789123317.254309:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123317.254376:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381280896:0@lo:400:kworker.0 00000100:00100000:3.0:1789123317.254424:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123317.254454:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789123317.254459:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876031381280768:0@lo:400:kworker.0 00000100:00100000:3.0:1789123317.254483:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123317.254510:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062cb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381280384:0@lo:400:kworker.0 00000100:00100000:3.0:1789123317.254539:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123317.254558:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789123317.254584:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381280640:0@lo:400:kworker.0 00000100:00100000:3.0:1789123317.254616:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123317.254669:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062c9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876031381280512:0@lo:8:kworker.0 00000100:00100000:3.0:1789123317.254710:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123317.254749:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381280256 00000100:00100000:3.0:1789123317.254756:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381280256 00000100:00100000:2.0:1789123317.254778:0:15357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381280384 00000100:00100000:3.0:1789123317.254802:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789123317.254811:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427b22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+19:3305:x1876031381280256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123317.254856:0:15357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381280384 00000100:00100000:3.0:1789123317.254857:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427b22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+19:3305:x1876031381280256:12345-0@lo:400:kworker.0 Request processed in 47us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123317.254867:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789123317.254903:0:15357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381280512 00000100:00100000:2.0:1789123317.254908:0:15357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381280512 00000100:00100000:2.0:1789123317.254923:0:15357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789123317.254931:0:15357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062c8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381280384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123317.254978:0:15357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062c8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381280384:12345-0@lo:400:kworker.0 Request processed in 47us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123317.254992:0:15357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789123317.255011:0:15357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789123317.255016:0:15357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3301:x1876031381280512:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789123317.255042:0:15357:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 431 last 0 00000020:00000080:2.0:1789123317.255078:0:15357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7e1648d68fc92e1a 00002000:00100000:2.0:1789123317.255095:0:15357:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9f3441fb9000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398a ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789123317.255100:0:15357:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789123317.255103:0:15357:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789123317.255900:0:15357:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789123317.255929:0:15357:0:(import.c:65:import_set_state_nolock()) ffff9f3441fbf800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789123317.255986:0:15357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1876031381280512:12345-0@lo:8:kworker.0 Request processed in 968us (1274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123317.255995:0:15357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1789123317.256018:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789123317.256067:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34062c9e00 x1876031381280512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789123342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789123317.256083:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789123317.256090:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789123317.256094:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789123317.256096:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9f343b0d7000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789123317.256115:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789123317.256120:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062c9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876031381280512:0@lo:8:kworker.0 00000004:00080000:2.0:1789123317.256170:0:14695:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1789123317.256188:0:14695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c30ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14695:1876031381281152:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789123317.256216:0:14695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123317.256243:0:14695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3402be29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789123317.256254:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789123317.256262:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c30a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381281024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789123317.256288:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123317.256317:0:15358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381281024 00000100:00100000:2.0:1789123317.256323:0:15358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381281024 00000100:00100000:2.0:1789123317.256418:0:15358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789123317.256426:0:15358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c309e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1876031381281024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789123317.256449:0:15358:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123317.256486:0:15358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c309e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1876031381281024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123317.256492:0:15358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789123317.256510:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789123317.256526:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f343c30a580 x1876031381281024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789123333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123317.256540:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c30a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876031381281024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789123317.256567:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062cb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381280384:0@lo:400:kworker.0 00000100:00100000:2.0:1789123317.256582:0:15357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381281152 00000100:00100000:2.0:1789123317.256586:0:15357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381281152 00000100:00100000:2.0:1789123317.256608:0:15357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789123317.256613:0:15357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c3083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14695:x1876031381281152:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789123317.257296:0:14671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381280896 00000100:00100000:3.0:1789123317.257304:0:14671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381280896 00000100:00100000:3.0:1789123317.257347:0:14671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381280768 00000100:00100000:3.0:1789123317.257351:0:14671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381280768 00000100:00100000:3.0:1789123317.257366:0:14671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381280640 00000100:00100000:3.0:1789123317.257368:0:14671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381280640 00000100:00100000:3.0:1789123317.257382:0:14671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789123317.257389:0:14671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876031381280896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123317.257440:0:14671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876031381280896:12345-0@lo:400:kworker.0 Request processed in 51us (3015us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123317.257449:0:14671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789123317.257465:0:14671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789123317.257472:0:14671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876031381280768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123317.257507:0:14671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876031381280768:12345-0@lo:400:kworker.0 Request processed in 36us (3023us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123317.257513:0:14671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789123317.257537:0:14671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789123317.257546:0:14671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381280640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123317.257591:0:14671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381280640:12345-0@lo:400:kworker.0 Request processed in 46us (2973us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123317.257598:0:14671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:1.0:1789123317.257991:0:14694:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00080000:2.0:1789123317.258128:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789123317.258165:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34062cb0c0 x1876031381280640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789123317.258179:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381280640:0@lo:400:kworker.0 00010000:00080000:3.0:1789123317.258282:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34062cad00 x1876031381280768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123317.258293:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876031381280768:0@lo:400:kworker.0 00000100:00100000:3.0:1789123317.258305:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39ef4522-e133-4b32-b80c-ca92d5b19344:3305:1876031381280256:0@lo:400:kworker.0 00010000:00080000:3.0:1789123317.258314:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f34062c9a40 x1876031381280896/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789123333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789123317.258322:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876031381280896:0@lo:400:kworker.0 00000004:00080000:1.0:1789123317.259357:0:14694:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 431589726809ns, next at 0ns, rc = 0 00002000:00080000:0.0:1789123317.268847:0:15357:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1789123317.268968:0:15357:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1789123317.268974:0:15357:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:0.0:1789123317.288567:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789123317.288578:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc92e21 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.288594:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1789123317.288598:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123317.288605:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc92e21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.288620:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc92e21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.288655:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc92e21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.288663:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc92e21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.288688:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789123317.288720:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789123317.288729:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc92e21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123317.288741:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52800 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:3.0:1789123317.288746:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc92e21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123317.288768:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc92e21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123317.288792:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc92e21 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123317.288807:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc92e21 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123317.288829:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123317.288832:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123317.288835:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789123317.294194:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789123317.294215:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc92e28 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.294240:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1789123317.294245:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123317.294251:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc92e28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.294265:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc92e28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.294276:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc92e28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.294284:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc92e28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.294307:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789123317.294345:0:14660:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789123317.294360:0:14660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc92e28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.294371:0:14660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52400 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:2.0:1789123317.294376:0:14660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc92e28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.294386:0:14660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc92e28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.294408:0:14660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc92e28 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.294416:0:14660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc92e28 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.294434:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123317.294436:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123317.294438:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789123317.297414:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123317.297427:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043f9ac89/0x7e1648d68fc92e2f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.297443:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=431s v=(0 0) 00010000:00010000:1.0:1789123317.297448:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123317.297455:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043f9ac89/0x7e1648d68fc92e2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.297471:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043f9ac89/0x7e1648d68fc92e2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.297482:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043f9ac89/0x7e1648d68fc92e2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.297491:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043f9ac89/0x7e1648d68fc92e2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.297506:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789123317.298282:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123317.298289:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000067988f5/0x7e1648d68fc92e36 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.298311:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=431s v=(0 0) 00010000:00010000:1.0:1789123317.298315:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123317.298320:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000067988f5/0x7e1648d68fc92e36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.298333:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000067988f5/0x7e1648d68fc92e36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.298341:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000067988f5/0x7e1648d68fc92e36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.298349:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000067988f5/0x7e1648d68fc92e36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.298366:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789123317.298379:0:14660:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789123317.298386:0:14660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043f9ac89/0x7e1648d68fc92e2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.298394:0:14660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3303949c00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123317.298399:0:14660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043f9ac89/0x7e1648d68fc92e2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.298407:0:14660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043f9ac89/0x7e1648d68fc92e2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.298437:0:14660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043f9ac89/0x7e1648d68fc92e2f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.298444:0:14660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043f9ac89/0x7e1648d68fc92e2f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.298461:0:14660:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789123317.298465:0:14660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000067988f5/0x7e1648d68fc92e36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.298472:0:14660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3303948200 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123317.298476:0:14660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000067988f5/0x7e1648d68fc92e36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.298484:0:14660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000067988f5/0x7e1648d68fc92e36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.298495:0:14660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000067988f5/0x7e1648d68fc92e36 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.298502:0:14660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000067988f5/0x7e1648d68fc92e36 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.298516:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123317.298519:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123317.298528:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789123317.299199:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123317.299207:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1a1b86f/0x7e1648d68fc92e3d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123317.299214:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123317.299217:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=431s v=(0 0) 00010000:00010000:1.0:1789123317.299222:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123317.299227:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1a1b86f/0x7e1648d68fc92e3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.299238:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1a1b86f/0x7e1648d68fc92e3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.299247:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1a1b86f/0x7e1648d68fc92e3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.299254:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1a1b86f/0x7e1648d68fc92e3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.299279:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789123317.299379:0:14660:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789123317.299387:0:14660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1a1b86f/0x7e1648d68fc92e3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.299397:0:14660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3303949000 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:2.0:1789123317.299400:0:14660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1a1b86f/0x7e1648d68fc92e3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.299421:0:14660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1a1b86f/0x7e1648d68fc92e3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.299436:0:14660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1a1b86f/0x7e1648d68fc92e3d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.299443:0:14660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1a1b86f/0x7e1648d68fc92e3d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.299465:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123317.299467:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123317.299470:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789123317.299726:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123317.299732:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000167a181d/0x7e1648d68fc92e44 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.299741:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=431s v=(0 0) 00010000:00010000:1.0:1789123317.299744:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123317.299748:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000167a181d/0x7e1648d68fc92e44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.299767:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000167a181d/0x7e1648d68fc92e44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.299776:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000167a181d/0x7e1648d68fc92e44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.299783:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000167a181d/0x7e1648d68fc92e44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.299804:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789123317.299828:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789123317.299835:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000167a181d/0x7e1648d68fc92e44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123317.299845:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3303948600 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:3.0:1789123317.299849:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000167a181d/0x7e1648d68fc92e44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123317.299858:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000167a181d/0x7e1648d68fc92e44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123317.299880:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000167a181d/0x7e1648d68fc92e44 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123317.299888:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000167a181d/0x7e1648d68fc92e44 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123317.299903:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123317.299905:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123317.299913:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789123317.300578:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123317.300585:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001080d8db/0x7e1648d68fc92e4b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.300595:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=431s v=(0 0) 00010000:00010000:1.0:1789123317.300599:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123317.300603:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001080d8db/0x7e1648d68fc92e4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.300613:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001080d8db/0x7e1648d68fc92e4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.300621:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001080d8db/0x7e1648d68fc92e4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.300661:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001080d8db/0x7e1648d68fc92e4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.300690:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789123317.301239:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123317.301245:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005df24f1c/0x7e1648d68fc92e52 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.301254:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=431s v=(0 0) 00010000:00010000:1.0:1789123317.301258:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123317.301262:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005df24f1c/0x7e1648d68fc92e52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.301271:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005df24f1c/0x7e1648d68fc92e52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.301279:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005df24f1c/0x7e1648d68fc92e52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.301286:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005df24f1c/0x7e1648d68fc92e52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.301307:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789123317.301622:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789123317.301647:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001080d8db/0x7e1648d68fc92e4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123317.301657:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3303948a00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:3.0:1789123317.301661:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001080d8db/0x7e1648d68fc92e4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123317.301671:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001080d8db/0x7e1648d68fc92e4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123317.301695:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001080d8db/0x7e1648d68fc92e4b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123317.301703:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001080d8db/0x7e1648d68fc92e4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123317.301721:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789123317.301724:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005df24f1c/0x7e1648d68fc92e52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123317.301731:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3303949a00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:3.0:1789123317.301734:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005df24f1c/0x7e1648d68fc92e52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789123317.301738:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789123317.301744:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005df24f1c/0x7e1648d68fc92e52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.301747:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032a80e10/0x7e1648d68fc92e59 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.301764:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=431s v=(0 0) 00010000:00010000:1.0:1789123317.301772:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789123317.301774:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123317.301779:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032a80e10/0x7e1648d68fc92e59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123317.301780:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005df24f1c/0x7e1648d68fc92e52 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123317.301801:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005df24f1c/0x7e1648d68fc92e52 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.301803:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032a80e10/0x7e1648d68fc92e59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123317.301824:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123317.301826:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123317.301828:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123317.301836:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032a80e10/0x7e1648d68fc92e59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.302058:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032a80e10/0x7e1648d68fc92e59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.302080:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789123317.302175:0:14660:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789123317.302183:0:14660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032a80e10/0x7e1648d68fc92e59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.302207:0:14660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3303949e00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:2.0:1789123317.302211:0:14660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032a80e10/0x7e1648d68fc92e59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.302230:0:14660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032a80e10/0x7e1648d68fc92e59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.302244:0:14660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032a80e10/0x7e1648d68fc92e59 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.302259:0:14660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032a80e10/0x7e1648d68fc92e59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.302279:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123317.302283:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123317.302286:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789123317.302545:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123317.302551:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000524327df/0x7e1648d68fc92e60 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.302561:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=431s v=(0 0) 00010000:00010000:1.0:1789123317.302564:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123317.302569:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000524327df/0x7e1648d68fc92e60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.302579:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000524327df/0x7e1648d68fc92e60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.302600:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000524327df/0x7e1648d68fc92e60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.302608:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000524327df/0x7e1648d68fc92e60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.303822:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789123317.304371:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123317.304379:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b47137a0/0x7e1648d68fc92e67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.304394:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=431s v=(0 0) 00010000:00010000:1.0:1789123317.304398:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123317.304403:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b47137a0/0x7e1648d68fc92e67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.304415:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b47137a0/0x7e1648d68fc92e67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.304424:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b47137a0/0x7e1648d68fc92e67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.304432:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b47137a0/0x7e1648d68fc92e67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.304462:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789123317.304474:0:14660:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789123317.304479:0:14660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000524327df/0x7e1648d68fc92e60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.304486:0:14660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3303949200 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123317.304490:0:14660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000524327df/0x7e1648d68fc92e60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.304499:0:14660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000524327df/0x7e1648d68fc92e60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.304514:0:14660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000524327df/0x7e1648d68fc92e60 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.304522:0:14660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000524327df/0x7e1648d68fc92e60 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.304555:0:14660:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789123317.304558:0:14660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b47137a0/0x7e1648d68fc92e67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.304565:0:14660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3303948400 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123317.304568:0:14660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b47137a0/0x7e1648d68fc92e67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.304587:0:14660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b47137a0/0x7e1648d68fc92e67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.304597:0:14660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b47137a0/0x7e1648d68fc92e67 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.304605:0:14660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b47137a0/0x7e1648d68fc92e67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.304660:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123317.304662:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123317.304663:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789123317.305101:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123317.305106:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000107614ba/0x7e1648d68fc92e6e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.305115:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=431s v=(0 0) 00010000:00010000:1.0:1789123317.305118:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123317.305122:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000107614ba/0x7e1648d68fc92e6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.305131:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000107614ba/0x7e1648d68fc92e6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.305138:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000107614ba/0x7e1648d68fc92e6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.305152:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000107614ba/0x7e1648d68fc92e6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.305165:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789123317.305173:0:14660:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789123317.305176:0:14660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000107614ba/0x7e1648d68fc92e6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.305182:0:14660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3303949800 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123317.305185:0:14660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000107614ba/0x7e1648d68fc92e6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.305194:0:14660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000107614ba/0x7e1648d68fc92e6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.305204:0:14660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000107614ba/0x7e1648d68fc92e6e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.305211:0:14660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000107614ba/0x7e1648d68fc92e6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.305225:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123317.305226:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123317.305228:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789123317.305575:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123317.305588:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5511b9d/0x7e1648d68fc92e75 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.305598:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=431s v=(0 0) 00010000:00010000:1.0:1789123317.305601:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123317.305606:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5511b9d/0x7e1648d68fc92e75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.305616:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5511b9d/0x7e1648d68fc92e75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.305624:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5511b9d/0x7e1648d68fc92e75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.305658:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5511b9d/0x7e1648d68fc92e75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.305671:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789123317.305690:0:14660:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789123317.305694:0:14660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5511b9d/0x7e1648d68fc92e75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.305702:0:14660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3303949400 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123317.305705:0:14660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5511b9d/0x7e1648d68fc92e75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.305714:0:14660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5511b9d/0x7e1648d68fc92e75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.305731:0:14660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5511b9d/0x7e1648d68fc92e75 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.305739:0:14660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5511b9d/0x7e1648d68fc92e75 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.305753:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123317.305754:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123317.305756:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789123317.306118:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123317.306124:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecce6e7e/0x7e1648d68fc92e7c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.306133:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=431s v=(0 0) 00010000:00010000:1.0:1789123317.306136:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123317.306141:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecce6e7e/0x7e1648d68fc92e7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.306151:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecce6e7e/0x7e1648d68fc92e7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.306160:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecce6e7e/0x7e1648d68fc92e7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.306168:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecce6e7e/0x7e1648d68fc92e7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.306194:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789123317.306202:0:14660:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789123317.306207:0:14660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecce6e7e/0x7e1648d68fc92e7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.306214:0:14660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3303949600 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123317.306218:0:14660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecce6e7e/0x7e1648d68fc92e7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.306226:0:14660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecce6e7e/0x7e1648d68fc92e7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.306238:0:14660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecce6e7e/0x7e1648d68fc92e7c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.306246:0:14660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecce6e7e/0x7e1648d68fc92e7c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.306260:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123317.306261:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123317.306263:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789123317.306598:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123317.306603:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065590729/0x7e1648d68fc92e83 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.306611:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=431s v=(0 0) 00010000:00010000:1.0:1789123317.306620:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123317.306649:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065590729/0x7e1648d68fc92e83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.307849:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123317.308083:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065590729/0x7e1648d68fc92e83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.308104:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065590729/0x7e1648d68fc92e83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.308112:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065590729/0x7e1648d68fc92e83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.308127:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789123317.308138:0:14660:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789123317.308143:0:14660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065590729/0x7e1648d68fc92e83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.308161:0:14660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401514e00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123317.308165:0:14660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065590729/0x7e1648d68fc92e83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.308175:0:14660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065590729/0x7e1648d68fc92e83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.308192:0:14660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065590729/0x7e1648d68fc92e83 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.308213:0:14660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065590729/0x7e1648d68fc92e83 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.308233:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123317.308235:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123317.308236:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789123317.315546:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789123317.315560:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc92e8a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.315576:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1789123317.315581:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123317.315586:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc92e8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.315600:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc92e8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.315650:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc92e8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.315658:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc92e8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.315686:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789123317.316190:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789123317.316197:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc92e91 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.316206:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1789123317.316209:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123317.316213:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc92e91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.316222:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc92e91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.316229:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc92e91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.316236:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc92e91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.316264:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789123317.316625:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789123317.316652:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038f0f86b/0x7e1648d68fc92e98 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.316660:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1789123317.316663:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123317.316667:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038f0f86b/0x7e1648d68fc92e98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.316690:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038f0f86b/0x7e1648d68fc92e98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.316698:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038f0f86b/0x7e1648d68fc92e98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.316705:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038f0f86b/0x7e1648d68fc92e98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.316713:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1789123317.317062:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789123317.317068:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e74ed8fc/0x7e1648d68fc92e9f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.317075:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1789123317.317082:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123317.317086:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e74ed8fc/0x7e1648d68fc92e9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.317094:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e74ed8fc/0x7e1648d68fc92e9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.317101:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e74ed8fc/0x7e1648d68fc92e9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.317108:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e74ed8fc/0x7e1648d68fc92e9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.317115:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1789123317.317458:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789123317.317464:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a02942a/0x7e1648d68fc92ea6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.317472:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1789123317.317475:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123317.317478:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a02942a/0x7e1648d68fc92ea6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.317486:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a02942a/0x7e1648d68fc92ea6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.317492:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a02942a/0x7e1648d68fc92ea6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.317504:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a02942a/0x7e1648d68fc92ea6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.317511:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1789123317.318590:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789123317.318779:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc92e8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.318791:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52400 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:2.0:1789123317.318795:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc92e8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.318805:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc92e8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.318823:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc92e8a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.318831:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc92e8a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.318851:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789123317.318855:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc92e91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.319047:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52800 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:2.0:1789123317.319051:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc92e91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.319061:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc92e91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.319072:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc92e91 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.319078:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005b5b201/0x7e1648d68fc92e91 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.319091:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789123317.319095:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038f0f86b/0x7e1648d68fc92e98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.319101:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53600 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:2.0:1789123317.319104:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038f0f86b/0x7e1648d68fc92e98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.319112:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038f0f86b/0x7e1648d68fc92e98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.319122:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038f0f86b/0x7e1648d68fc92e98 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.319137:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038f0f86b/0x7e1648d68fc92e98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.319152:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789123317.319156:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e74ed8fc/0x7e1648d68fc92e9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.319162:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53a00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:2.0:1789123317.319165:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e74ed8fc/0x7e1648d68fc92e9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.319171:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e74ed8fc/0x7e1648d68fc92e9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.319181:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e74ed8fc/0x7e1648d68fc92e9f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.319188:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e74ed8fc/0x7e1648d68fc92e9f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.320063:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789123317.320071:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a02942a/0x7e1648d68fc92ea6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.320079:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52c00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:2.0:1789123317.320091:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a02942a/0x7e1648d68fc92ea6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.320100:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a02942a/0x7e1648d68fc92ea6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.320114:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a02942a/0x7e1648d68fc92ea6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.320121:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a02942a/0x7e1648d68fc92ea6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.320140:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123317.320142:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123317.320145:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789123317.322833:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789123317.322844:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2ba8f2a/0x7e1648d68fc92ead lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.322861:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1789123317.322866:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123317.322872:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2ba8f2a/0x7e1648d68fc92ead lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.322886:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2ba8f2a/0x7e1648d68fc92ead lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.322896:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2ba8f2a/0x7e1648d68fc92ead lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.322905:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2ba8f2a/0x7e1648d68fc92ead lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.322922:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789123317.323299:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789123317.323305:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7816300/0x7e1648d68fc92eb4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.323321:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1789123317.323324:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123317.323329:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7816300/0x7e1648d68fc92eb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.323339:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7816300/0x7e1648d68fc92eb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.323347:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7816300/0x7e1648d68fc92eb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.323350:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789123317.323359:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7816300/0x7e1648d68fc92eb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.323360:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2ba8f2a/0x7e1648d68fc92ead lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123317.323378:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789123317.323379:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52a00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:2.0:1789123317.323385:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2ba8f2a/0x7e1648d68fc92ead lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.323394:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2ba8f2a/0x7e1648d68fc92ead lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.323412:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2ba8f2a/0x7e1648d68fc92ead lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.323427:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2ba8f2a/0x7e1648d68fc92ead lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.323461:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789123317.323465:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7816300/0x7e1648d68fc92eb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.323482:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53c00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:2.0:1789123317.323493:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7816300/0x7e1648d68fc92eb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.323502:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7816300/0x7e1648d68fc92eb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.323513:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7816300/0x7e1648d68fc92eb4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.323520:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7816300/0x7e1648d68fc92eb4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.323541:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123317.323543:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123317.323546:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123317.323802:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789123317.323892:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123317.323899:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000311c4589/0x7e1648d68fc92ebb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.323909:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=431s v=(0 0) 00010000:00010000:1.0:1789123317.323912:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123317.323917:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000311c4589/0x7e1648d68fc92ebb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.323927:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000311c4589/0x7e1648d68fc92ebb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.323937:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000311c4589/0x7e1648d68fc92ebb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.323945:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000311c4589/0x7e1648d68fc92ebb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.323967:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789123317.324770:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123317.324778:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065590729/0x7e1648d68fc92ec2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.324789:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=431s v=(0 0) 00010000:00010000:1.0:1789123317.324792:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123317.324796:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065590729/0x7e1648d68fc92ec2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.324806:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065590729/0x7e1648d68fc92ec2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.324814:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065590729/0x7e1648d68fc92ec2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.324822:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065590729/0x7e1648d68fc92ec2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.324839:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789123317.324851:0:14660:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789123317.324857:0:14660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000311c4589/0x7e1648d68fc92ebb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.324864:0:14660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401515a00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123317.324874:0:14660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000311c4589/0x7e1648d68fc92ebb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.324895:0:14660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000311c4589/0x7e1648d68fc92ebb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.324907:0:14660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000311c4589/0x7e1648d68fc92ebb lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.324914:0:14660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000311c4589/0x7e1648d68fc92ebb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.324929:0:14660:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789123317.324932:0:14660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065590729/0x7e1648d68fc92ec2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.324939:0:14660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401514e00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123317.324942:0:14660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065590729/0x7e1648d68fc92ec2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.324950:0:14660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065590729/0x7e1648d68fc92ec2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.324960:0:14660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065590729/0x7e1648d68fc92ec2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.324967:0:14660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065590729/0x7e1648d68fc92ec2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.324988:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123317.324990:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123317.324992:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789123317.325901:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123317.325911:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a799fe24/0x7e1648d68fc92ec9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.325923:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=431s v=(0 0) 00010000:00010000:1.0:1789123317.325927:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123317.325932:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a799fe24/0x7e1648d68fc92ec9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.325944:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a799fe24/0x7e1648d68fc92ec9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.325952:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a799fe24/0x7e1648d68fc92ec9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.325959:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a799fe24/0x7e1648d68fc92ec9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.325973:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789123317.326311:0:14660:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789123317.326319:0:14660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a799fe24/0x7e1648d68fc92ec9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123317.326329:0:14660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401514000 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:3.0:1789123317.326333:0:14660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a799fe24/0x7e1648d68fc92ec9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123317.326343:0:14660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a799fe24/0x7e1648d68fc92ec9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123317.326358:0:14660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a799fe24/0x7e1648d68fc92ec9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123317.326366:0:14660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a799fe24/0x7e1648d68fc92ec9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123317.326400:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123317.326402:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789123317.326404:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123317.326523:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789123317.326594:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123317.326600:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065589c12/0x7e1648d68fc92ed0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.326619:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=431s v=(0 0) 00010000:00010000:1.0:1789123317.326622:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123317.326647:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065589c12/0x7e1648d68fc92ed0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.326658:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065589c12/0x7e1648d68fc92ed0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.326748:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065589c12/0x7e1648d68fc92ed0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.326755:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065589c12/0x7e1648d68fc92ed0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.326770:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789123317.326779:0:14660:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789123317.326784:0:14660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065589c12/0x7e1648d68fc92ed0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.326791:0:14660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401515000 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123317.326794:0:14660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065589c12/0x7e1648d68fc92ed0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.326803:0:14660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065589c12/0x7e1648d68fc92ed0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.326825:0:14660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065589c12/0x7e1648d68fc92ed0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.326833:0:14660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065589c12/0x7e1648d68fc92ed0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.326847:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123317.326848:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789123317.326850:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789123317.327447:0:15357:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789123317.327455:0:15357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae8d9a59/0x7e1648d68fc92ed7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.327465:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=431s v=(0 0) 00010000:00010000:1.0:1789123317.327468:0:15357:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123317.327473:0:15357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae8d9a59/0x7e1648d68fc92ed7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.327484:0:15357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae8d9a59/0x7e1648d68fc92ed7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.327493:0:15357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae8d9a59/0x7e1648d68fc92ed7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.327500:0:15357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae8d9a59/0x7e1648d68fc92ed7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123317.327530:0:15357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1789123317.327858:0:15357:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:1.0:1789123317.327951:0:15357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c3083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14695:x1876031381281152:12345-0@lo:5:osp-pre-1-0.0 Request processed in 71334us (71730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123317.327961:0:15357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1789123317.328006:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789123317.328015:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae8d9a59/0x7e1648d68fc92ed7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123317.328023:0:14695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c30ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14695:1876031381281152:0@lo:5:osp-pre-1-0.0 00010000:00010000:2.0:1789123317.328038:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401515e00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:2.0:1789123317.328044:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae8d9a59/0x7e1648d68fc92ed7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789123317.328044:0:14695:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00010000:00010000:2.0:1789123317.328061:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae8d9a59/0x7e1648d68fc92ed7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.328077:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae8d9a59/0x7e1648d68fc92ed7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.328085:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae8d9a59/0x7e1648d68fc92ed7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123317.328102:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123317.328104:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123317.328106:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123317.328506:0:14695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f33035a8b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14695:1876031381281280:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789123317.328548:0:14695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123317.328603:0:14695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410079cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789123317.328605:0:15356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381281280 00000100:00100000:2.0:1789123317.328613:0:15356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381281280 00000100:00100000:2.0:1789123317.328707:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789123317.328717:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f33035a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14695:x1876031381281280:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789123317.328755:0:15355:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000004:00080000:0.0:1789123317.338365:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1789123317.338535:0:14695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f33035a8b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14695:1876031381281280:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789123317.338551:0:14695:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1789123317.339070:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f33035a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14695:x1876031381281280:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10352us (10518us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789123317.339081:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000001:02000400:0.0:1789123317.807294:0:16433:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789123317.892859:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123318.916846:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123319.940784:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123320.237501:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123320.237610:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364507264 00000100:00100000:1.0:1789123320.237619:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364507264 00000100:00100000:1.0:1789123320.237709:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 75 00000100:00100000:1.0:1789123320.237717:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427b20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2351:x1876031364507264:12345-192.168.206.30@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789123320.237746:0:14663:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from e75c46a1-b06d-458e-9df3-84f8d5648d06@192.168.206.30@tcp t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:1.0:1789123320.237774:0:14663:0:(genops.c:1385:class_connect()) connect: client e75c46a1-b06d-458e-9df3-84f8d5648d06, cookie 0x7e1648d68fc92ede 00000100:00080000:1.0:1789123320.237889:0:14663:0:(import.c:65:import_set_state_nolock()) ffff9f3302bf5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789123320.237956:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427b20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e75c46a1-b06d-458e-9df3-84f8d5648d06+5:2351:x1876031364507264:12345-192.168.206.30@tcp:250:mount.lustre.0 Request processed in 238us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123320.237963:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 75 00000100:00100000:0.0:1789123320.256699:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123320.257231:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364507392 00000100:00100000:3.0:1789123320.257242:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364507392 00000100:00100000:3.0:1789123320.257306:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 76 00000100:00100000:3.0:1789123320.257316:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427b22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e75c46a1-b06d-458e-9df3-84f8d5648d06+5:13941:x1876031364507392:12345-192.168.206.30@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789123320.257331:0:14666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123320.257349:0:14666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3402fbbe00/0x7e1648d68fc92ee5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f916 expref: -99 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123320.257376:0:14666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3402fbbe00/0x7e1648d68fc92ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f916 expref: 6 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123320.257386:0:14666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3402fbbe00/0x7e1648d68fc92ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f916 expref: 6 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123320.257395:0:14666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbbe00, rc 0) 00000100:00100000:3.0:1789123320.257458:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427b22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e75c46a1-b06d-458e-9df3-84f8d5648d06+6:13941:x1876031364507392:12345-192.168.206.30@tcp:101:mount.lustre.0 Request processed in 143us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123320.257465:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 76 00000100:00100000:2.0:1789123320.261933:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123320.263412:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364507520 00000100:00100000:1.0:1789123320.263465:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364507520 00000100:00100000:1.0:1789123320.263558:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 77 00000100:00100000:1.0:1789123320.263581:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3427b21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e75c46a1-b06d-458e-9df3-84f8d5648d06+6:13941:x1876031364507520:12345-192.168.206.30@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789123320.264048:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3427b21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e75c46a1-b06d-458e-9df3-84f8d5648d06+6:13941:x1876031364507520:12345-192.168.206.30@tcp:501:mount.lustre.0 Request processed in 468us (2123us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789123320.264069:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 77 00000100:00100000:0.0:1789123320.268605:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123320.268713:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364507648 00000100:00100000:2.0:1789123320.268723:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364507648 00000100:00100000:2.0:1789123320.268765:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 78 00000100:00100000:2.0:1789123320.268773:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343b0f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e75c46a1-b06d-458e-9df3-84f8d5648d06+6:13941:x1876031364507648:12345-192.168.206.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789123320.268789:0:14665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123320.268804:0:14665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f342d80b200/0x7e1648d68fc92eec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f91d expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123320.268829:0:14665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f342d80b200/0x7e1648d68fc92eec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f91d expref: 7 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123320.268840:0:14665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f342d80b200/0x7e1648d68fc92eec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f91d expref: 7 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123320.268849:0:14665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80b200, rc 0) 00000100:00100000:2.0:1789123320.268908:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343b0f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e75c46a1-b06d-458e-9df3-84f8d5648d06+7:13941:x1876031364507648:12345-192.168.206.30@tcp:101:mount.lustre.0 Request processed in 135us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123320.268916:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 78 00000100:00100000:0.0:1789123320.275264:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123320.275344:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364507776 00000100:00100000:3.0:1789123320.275353:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364507776 00000100:00100000:3.0:1789123320.275408:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 79 00000100:00100000:3.0:1789123320.275418:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343b0f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e75c46a1-b06d-458e-9df3-84f8d5648d06+7:13941:x1876031364507776:12345-192.168.206.30@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789123320.276058:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343b0f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e75c46a1-b06d-458e-9df3-84f8d5648d06+8:13941:x1876031364507776:12345-192.168.206.30@tcp:501:mount.lustre.0 Request processed in 638us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123320.276075:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 79 00000100:00100000:3.0:1789123320.284494:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123320.288365:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364507904 00000100:00100000:1.0:1789123320.288381:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364507904 00000100:00100000:1.0:1789123320.288449:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 80 00000100:00100000:1.0:1789123320.288460:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343b0f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e75c46a1-b06d-458e-9df3-84f8d5648d06+8:13941:x1876031364507904:12345-192.168.206.30@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789123320.288986:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343b0f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e75c46a1-b06d-458e-9df3-84f8d5648d06+8:13941:x1876031364507904:12345-192.168.206.30@tcp:503:mount.lustre.0 Request processed in 526us (4499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123320.288996:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 80 00000100:00100000:0.0:1789123320.294477:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123320.295316:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364508032 00000100:00100000:3.0:1789123320.295327:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364508032 00000100:00100000:3.0:1789123320.297880:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 81 00000100:00100000:3.0:1789123320.297902:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343b0f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e75c46a1-b06d-458e-9df3-84f8d5648d06+8:13959:x1876031364508032:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789123320.298265:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343b0f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e75c46a1-b06d-458e-9df3-84f8d5648d06+8:13959:x1876031364508032:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 372us (3799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123320.298273:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 81 00000100:00100000:0.0:1789123320.317015:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123320.317516:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364508160 00000100:00100000:2.0:1789123320.317526:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364508160 00000100:00100000:2.0:1789123320.318953:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 82 00000100:00100000:2.0:1789123320.318969:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343b0f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e75c46a1-b06d-458e-9df3-84f8d5648d06+8:13959:x1876031364508160:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789123320.319239:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343b0f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e75c46a1-b06d-458e-9df3-84f8d5648d06+8:13959:x1876031364508160:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 274us (2888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123320.319247:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 82 00000100:00100000:1.0:1789123320.324947:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789123320.324970:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381281408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789123320.325051:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123320.325226:0:15358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381281408 00000100:00100000:0.0:1789123320.325234:0:15358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381281408 00000100:00100000:0.0:1789123320.325302:0:15358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789123320.325313:0:15358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f33035a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381281408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789123320.325346:0:15358:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789123320.325391:0:15358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f33035a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381281408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123320.325399:0:15358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789123320.326168:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789123320.326999:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381281408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789123320.339250:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123320.339602:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364508288 00000100:00100000:1.0:1789123320.339612:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364508288 00000100:00100000:1.0:1789123320.339695:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 83 00000100:00100000:1.0:1789123320.339854:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343b0f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e75c46a1-b06d-458e-9df3-84f8d5648d06+8:13941:x1876031364508288:12345-192.168.206.30@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789123320.339870:0:14663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123320.339886:0:14663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3401515200/0x7e1648d68fc92ef3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f947 expref: -99 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123320.339913:0:14663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3401515200/0x7e1648d68fc92ef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f947 expref: 9 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123320.339936:0:14663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3401515200/0x7e1648d68fc92ef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f947 expref: 9 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123320.339945:0:14663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3401515200, rc 0) 00000100:00100000:1.0:1789123320.340009:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343b0f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e75c46a1-b06d-458e-9df3-84f8d5648d06+9:13941:x1876031364508288:12345-192.168.206.30@tcp:101:mount.lustre.0 Request processed in 305us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123320.340016:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 83 00000100:00100000:3.0:1789123320.345519:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123320.345693:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364508416 00000100:00100000:2.0:1789123320.345838:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364508416 00000100:00100000:2.0:1789123320.345896:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 84 00000100:00100000:2.0:1789123320.345906:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343b0f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e75c46a1-b06d-458e-9df3-84f8d5648d06+9:13941:x1876031364508416:12345-192.168.206.30@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789123320.345930:0:14665:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789123320.345953:0:14665:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789123320.345957:0:14665:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789123320.345961:0:14665:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789123320.345963:0:14665:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789123320.351884:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343b0f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e75c46a1-b06d-458e-9df3-84f8d5648d06+9:13941:x1876031364508416:12345-192.168.206.30@tcp:256:mount.lustre.0 Request processed in 5970us (6364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123320.351898:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 84 00000100:00100000:0.0:1789123320.360293:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123320.360451:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364508544 00000100:00100000:1.0:1789123320.360461:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364508544 00000100:00100000:1.0:1789123320.360566:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 85 00000100:00100000:1.0:1789123320.360577:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e75c46a1-b06d-458e-9df3-84f8d5648d06+9:13941:x1876031364508544:12345-192.168.206.30@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789123320.360595:0:14663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123320.360616:0:14663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3401515600/0x7e1648d68fc92efa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f94e expref: -99 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123320.360696:0:14663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3401515600/0x7e1648d68fc92efa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f94e expref: 10 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123320.360719:0:14663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3401515600/0x7e1648d68fc92efa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f94e expref: 10 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123320.360728:0:14663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3401515600, rc 0) 00000100:00100000:1.0:1789123320.360794:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e75c46a1-b06d-458e-9df3-84f8d5648d06+10:13941:x1876031364508544:12345-192.168.206.30@tcp:101:mount.lustre.0 Request processed in 214us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123320.360802:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 85 00000100:00100000:3.0:1789123320.366750:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123320.367032:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364508672 00000100:00100000:2.0:1789123320.367041:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364508672 00000100:00100000:2.0:1789123320.367096:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 86 00000100:00100000:2.0:1789123320.367105:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e75c46a1-b06d-458e-9df3-84f8d5648d06+10:13941:x1876031364508672:12345-192.168.206.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789123320.367397:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e75c46a1-b06d-458e-9df3-84f8d5648d06+10:13941:x1876031364508672:12345-192.168.206.30@tcp:501:mount.lustre.0 Request processed in 291us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123320.367405:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 86 00000100:00100000:0.0:1789123320.377216:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123320.377429:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364508800 00000100:00100000:1.0:1789123320.377453:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364508800 00000100:00100000:1.0:1789123320.377526:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 87 00000100:00100000:1.0:1789123320.377535:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e75c46a1-b06d-458e-9df3-84f8d5648d06+10:13941:x1876031364508800:12345-192.168.206.30@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789123320.378242:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e75c46a1-b06d-458e-9df3-84f8d5648d06+10:13941:x1876031364508800:12345-192.168.206.30@tcp:503:mount.lustre.0 Request processed in 704us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123320.378252:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 87 00000100:00100000:0.0:1789123320.385970:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123320.386252:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364508928 00000100:00100000:3.0:1789123320.386262:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364508928 00000100:00100000:3.0:1789123320.386316:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 88 00000100:00100000:3.0:1789123320.386326:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e75c46a1-b06d-458e-9df3-84f8d5648d06+10:13963:x1876031364508928:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789123320.386683:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e75c46a1-b06d-458e-9df3-84f8d5648d06+10:13963:x1876031364508928:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 356us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123320.386692:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 88 00000100:00100000:3.0:1789123320.397422:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123320.397527:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364509056 00000100:00100000:2.0:1789123320.397537:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364509056 00000100:00100000:2.0:1789123320.397610:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 89 00000100:00100000:2.0:1789123320.397621:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e75c46a1-b06d-458e-9df3-84f8d5648d06+10:13963:x1876031364509056:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789123320.397953:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e75c46a1-b06d-458e-9df3-84f8d5648d06+10:13963:x1876031364509056:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 332us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123320.397963:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 89 00000100:00100000:0.0:1789123320.412899:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123320.413111:0:14671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364509184 00000100:00100000:3.0:1789123320.413120:0:14671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364509184 00000100:00100000:3.0:1789123320.413168:0:14671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 4 00000100:00100000:3.0:1789123320.413176:0:14671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2351:x1876031364509184:12345-192.168.206.30@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789123320.413221:0:14671:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from d3970986-6c0c-4726-808e-9ec9e5a9682c@192.168.206.30@tcp t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:3.0:1789123320.413287:0:14671:0:(genops.c:1385:class_connect()) connect: client d3970986-6c0c-4726-808e-9ec9e5a9682c, cookie 0x7e1648d68fc92f01 00000004:00100000:3.0:1789123320.413321:0:14671:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1789123320.413327:0:14671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1789123320.453148:0:14671:0:(import.c:65:import_set_state_nolock()) ffff9f3302bf5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789123320.453236:0:14671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+6:2351:x1876031364509184:12345-192.168.206.30@tcp:38:mount.lustre.0 Request processed in 40058us (40347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123320.453246:0:14671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 4 00000100:00100000:0.0:1789123320.459198:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123320.459311:0:14672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364509312 00000100:00100000:3.0:1789123320.459322:0:14672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364509312 00000100:00100000:3.0:1789123320.459392:0:14672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 5 00000100:00100000:3.0:1789123320.459403:0:14672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3970986-6c0c-4726-808e-9ec9e5a9682c+6:0:x1876031364509312:12345-192.168.206.30@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789123320.459444:0:14672:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789123320.459540:0:14672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3970986-6c0c-4726-808e-9ec9e5a9682c+6:0:x1876031364509312:12345-192.168.206.30@tcp:41:mount.lustre.0 Request processed in 138us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123320.459548:0:14672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 5 00000100:00080000:2.0:1789123320.460514:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789123320.462465:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123320.462563:0:14671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364509440 00000100:00100000:1.0:1789123320.462573:0:14671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364509440 00000100:00100000:1.0:1789123320.462771:0:14671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 6 00000100:00100000:1.0:1789123320.462782:0:14671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+6:13941:x1876031364509440:12345-192.168.206.30@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789123320.462821:0:14671:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789123320.462891:0:14671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+6:13941:x1876031364509440:12345-192.168.206.30@tcp:41:mount.lustre.0 Request processed in 111us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123320.462899:0:14671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 6 00000100:00100000:1.0:1789123320.465750:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123320.465951:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364509568 00000100:00100000:0.0:1789123320.465962:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364509568 00000100:00100000:0.0:1789123320.466027:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:0.0:1789123320.466037:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f33035aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+6:13941:x1876031364509568:12345-192.168.206.30@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789123320.466136:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f33035aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+6:13941:x1876031364509568:12345-192.168.206.30@tcp:40:mount.lustre.0 Request processed in 100us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123320.466143:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:0.0:1789123320.470149:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123320.470189:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123320.470234:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123320.470323:0:15956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364509696 00000100:00100000:2.0:1789123320.470333:0:15956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364509696 00000100:00100000:2.0:1789123320.470381:0:15956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364509824 00000100:00100000:2.0:1789123320.470385:0:15956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364509824 00000100:00100000:2.0:1789123320.470406:0:15956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 8 00000100:00100000:2.0:1789123320.470414:0:15956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1876031364509696:12345-192.168.206.30@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789123320.470445:0:15956:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from d3970986-6c0c-4726-808e-9ec9e5a9682c@192.168.206.30@tcp t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:2.0:1789123320.470479:0:15956:0:(genops.c:1385:class_connect()) connect: client d3970986-6c0c-4726-808e-9ec9e5a9682c, cookie 0x7e1648d68fc92f08 00002000:00100000:2.0:1789123320.470490:0:15956:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d3970986-6c0c-4726-808e-9ec9e5a9682c/ffff9f3441fbe000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789123320.470500:0:15956:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789123320.471041:0:15956:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789123320.471073:0:15956:0:(import.c:65:import_set_state_nolock()) ffff9f3441fba000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789123320.471135:0:15956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+6:2351:x1876031364509696:12345-192.168.206.30@tcp:8:mount.lustre.0 Request processed in 720us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123320.471142:0:15956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 8 00000100:00100000:2.0:1789123320.471163:0:15956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00100000:2.0:1789123320.471168:0:15956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1876031364509824:12345-192.168.206.30@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789123320.471185:0:15956:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from d3970986-6c0c-4726-808e-9ec9e5a9682c@192.168.206.30@tcp t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:2.0:1789123320.471202:0:15956:0:(genops.c:1385:class_connect()) connect: client d3970986-6c0c-4726-808e-9ec9e5a9682c, cookie 0x7e1648d68fc92f0f 00002000:00100000:2.0:1789123320.471208:0:15956:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d3970986-6c0c-4726-808e-9ec9e5a9682c/ffff9f3441fbd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789123320.471224:0:15956:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789123320.471342:0:15956:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789123320.471357:0:15956:0:(import.c:65:import_set_state_nolock()) ffff9f3441fb8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789123320.471398:0:15956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+6:2351:x1876031364509824:12345-192.168.206.30@tcp:8:mount.lustre.0 Request processed in 228us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123320.471405:0:15956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00100000:3.0:1789123320.472193:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364510080 00000100:00100000:3.0:1789123320.472201:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364510080 00000100:00100000:3.0:1789123320.472247:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 90 00000100:00100000:3.0:1789123320.472255:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301296850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e75c46a1-b06d-458e-9df3-84f8d5648d06+10:2353:x1876031364510080:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1789123320.472304:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301296850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e75c46a1-b06d-458e-9df3-84f8d5648d06+10:2353:x1876031364510080:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 50us (2069us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123320.472311:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 90 00000100:00100000:0.0:1789123320.477416:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123320.477524:0:14673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364509952 00000100:00100000:1.0:1789123320.477534:0:14673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364509952 00000100:00100000:1.0:1789123320.477935:0:14673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 0 00000100:00100000:1.0:1789123320.477946:0:14673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+6:13941:x1876031364509952:12345-192.168.206.30@tcp:33:mount.lustre.0 00000004:00080000:3.0:1789123320.482654:0:14673:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4635us 00000004:00200000:3.0:1789123320.501603:0:14673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1789123320.501810:0:14673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+6:13941:x1876031364509952:12345-192.168.206.30@tcp:33:mount.lustre.0 Request processed in 23862us (24399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123320.501826:0:14673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 0 00000100:00100000:0.0:1789123320.761920:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123320.762483:0:14671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364510208 00000100:00100000:1.0:1789123320.762494:0:14671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364510208 00000100:00100000:1.0:1789123320.762573:0:14671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 8 00000100:00100000:1.0:1789123320.762597:0:14671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+6:13985:x1876031364510208:12345-192.168.206.30@tcp:101:mkdir.0 00010000:00010000:1.0:1789123320.762616:0:14671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123320.762682:0:14671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514600/0x7e1648d68fc92f16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f978 expref: -99 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123320.762747:0:14671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc92f1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123320.762761:0:14671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc92f1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123320.762776:0:14671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc92f1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123320.762962:0:14671:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789123320.762966:0:14671:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1789123320.763966:0:14671:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc92f1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123320.764334:0:14671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514600/0x7e1648d68fc92f16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f978 expref: 8 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123320.764354:0:14671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc92f1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f978 expref: 7 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123320.764375:0:14671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f3409cd8e00) 00010000:00010000:1.0:1789123320.764378:0:14671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789123320.764382:0:14671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3401514c00, rc 0) 00000100:00100000:1.0:1789123320.764878:0:14671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+7:13985:x1876031364510208:12345-192.168.206.30@tcp:101:mkdir.0 Request processed in 2280us (2965us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123320.764901:0:14671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 8 00010000:00010000:2.0:1789123320.964838:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123321.988842:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123322.373065:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c3092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39ef4522-e133-4b32-b80c-ca92d5b19344:3304:1876031381281536:0@lo:400:kworker.0 00000100:00100000:2.0:1789123322.373144:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123322.373207:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c30a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381282048:0@lo:400:kworker.0 00000100:00100000:2.0:1789123322.373239:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123322.373241:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381281536 00000100:00100000:1.0:1789123322.373250:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381281536 00000100:00100000:2.0:1789123322.373268:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789123322.373276:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c309680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381281664:0@lo:400:kworker.0 00000100:00100000:1.0:1789123322.373293:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789123322.373304:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+19:3304:x1876031381281536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123322.373311:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123322.373333:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c309a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876031381282176:0@lo:400:kworker.0 00000100:00100000:2.0:1789123322.373372:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123322.373377:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+19:3304:x1876031381281536:12345-0@lo:400:kworker.0 Request processed in 73us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123322.373387:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789123322.373410:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c3092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39ef4522-e133-4b32-b80c-ca92d5b19344:3304:1876031381281536:0@lo:400:kworker.0 00000100:00100000:2.0:1789123322.373440:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c30a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381281792:0@lo:400:kworker.0 00000100:00100000:1.0:1789123322.373495:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343c30b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876031381281920:0@lo:400:kworker.0 00000100:00100000:1.0:1789123322.373527:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123322.373689:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381282048 00000100:00100000:0.0:1789123322.373693:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381282048 00000100:00100000:0.0:1789123322.373727:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381282176 00000100:00100000:0.0:1789123322.373730:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381282176 00000100:00100000:0.0:1789123322.373742:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381281920 00000100:00100000:0.0:1789123322.373744:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381281920 00000100:00100000:0.0:1789123322.373761:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789123322.373769:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381282048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123322.373806:0:14672:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789123322.373815:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381282048:12345-0@lo:400:kworker.0 Request processed in 46us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123322.373818:0:14672:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789123322.373827:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789123322.373843:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789123322.373851:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876031381282176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123322.373885:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876031381282176:12345-0@lo:400:kworker.0 Request processed in 35us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123322.373891:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789123322.373905:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789123322.373913:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f33035a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876031381281920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123322.373943:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f33035a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876031381281920:12345-0@lo:400:kworker.0 Request processed in 32us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123322.373950:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1789123322.373973:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789123322.374616:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123322.374682:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381282304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789123322.374715:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123322.374751:0:15358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381282304 00000100:00100000:2.0:1789123322.374757:0:15358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381282304 00000100:00100000:2.0:1789123322.374800:0:15358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789123322.374808:0:15358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1876031381282304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789123322.374839:0:15358:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123322.374876:0:15358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1876031381282304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123322.374893:0:15358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789123322.374911:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789123322.374923:0:15355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381281664 00000100:00100000:2.0:1789123322.374926:0:15355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381281664 00000100:00100000:2.0:1789123322.374955:0:15355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381281792 00000100:00100000:2.0:1789123322.374958:0:15355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381281792 00000100:00100000:2.0:1789123322.375153:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789123322.375162:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343c30ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381281664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123322.375198:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343c30ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381281664:12345-0@lo:400:kworker.0 Request processed in 38us (1890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123322.375204:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789123322.375217:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789123322.375223:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3302:x1876031381281792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123322.375263:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3302:x1876031381281792:12345-0@lo:400:kworker.0 Request processed in 41us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123322.375269:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789123322.378395:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c30b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876031381281920:0@lo:400:kworker.0 00000100:00080000:2.0:1789123322.379029:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789123322.379071:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381282304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789123322.379083:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c30a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381281792:0@lo:400:kworker.0 00000100:00100000:0.0:1789123322.380397:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c309680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381281664:0@lo:400:kworker.0 00000100:00100000:0.0:1789123322.380417:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c309a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876031381282176:0@lo:400:kworker.0 00000100:00100000:0.0:1789123322.380432:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343c30a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381282048:0@lo:400:kworker.0 00000001:00100000:0.0:1789123322.430092:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d3970986-6c0c-4726-808e-9ec9e5a9682c 00000001:00080000:0.0:1789123322.430107:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1789123322.430115:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789123322.816968:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123322.817075:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364510336 00000100:00100000:2.0:1789123322.817085:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364510336 00000100:00100000:2.0:1789123322.817156:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00100000:2.0:1789123322.817174:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+7:14037:x1876031364510336:12345-192.168.206.30@tcp:41:lfs.0 00000004:00000024:2.0:1789123322.817212:0:14670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789123322.817303:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+7:14037:x1876031364510336:12345-192.168.206.30@tcp:41:lfs.0 Request processed in 131us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123322.817324:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00080000:0.0:1789123322.817441:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789123322.824506:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123322.825255:0:15358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364510464 00000100:00100000:2.0:1789123322.825266:0:15358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364510464 00000100:00100000:2.0:1789123322.825347:0:15358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 5 00000100:00100000:2.0:1789123322.825358:0:15358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d3970986-6c0c-4726-808e-9ec9e5a9682c+6:14037:x1876031364510464:12345-192.168.206.30@tcp:13:lfs.0 00002000:00000024:2.0:1789123322.825396:0:15358:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123322.826083:0:15358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d3970986-6c0c-4726-808e-9ec9e5a9682c+6:14037:x1876031364510464:12345-192.168.206.30@tcp:13:lfs.0 Request processed in 724us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123322.826092:0:15358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 5 00000100:00080000:0.0:1789123322.827742:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789123322.831235:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123322.831483:0:15359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364510592 00000100:00100000:2.0:1789123322.831493:0:15359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364510592 00000100:00100000:2.0:1789123322.831935:0:15359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 6 00000100:00100000:2.0:1789123322.831945:0:15359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f33035aa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d3970986-6c0c-4726-808e-9ec9e5a9682c+5:14037:x1876031364510592:12345-192.168.206.30@tcp:13:lfs.0 00002000:00000024:2.0:1789123322.831979:0:15359:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123322.832817:0:15359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f33035aa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d3970986-6c0c-4726-808e-9ec9e5a9682c+5:14037:x1876031364510592:12345-192.168.206.30@tcp:13:lfs.0 Request processed in 869us (1585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123322.832827:0:15359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 6 00000100:00080000:0.0:1789123322.834123:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789123323.013249:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123323.037195:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123323.037310:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364510720 00000100:00100000:2.0:1789123323.037320:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364510720 00000100:00100000:1.0:1789123323.037453:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 92 00000100:00100000:1.0:1789123323.037464:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e75c46a1-b06d-458e-9df3-84f8d5648d06+10:14071:x1876031364510720:12345-192.168.206.30@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789123323.037480:0:14663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123323.037505:0:14663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3401514800/0x7e1648d68fc92f24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f97f expref: -99 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123323.037532:0:14663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3401514800/0x7e1648d68fc92f24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f97f expref: 11 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123323.037551:0:14663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3401514800/0x7e1648d68fc92f24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f97f expref: 11 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123323.037559:0:14663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3401514800, rc 0) 00000100:00100000:1.0:1789123323.037622:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e75c46a1-b06d-458e-9df3-84f8d5648d06+11:14071:x1876031364510720:12345-192.168.206.30@tcp:101:mount.lustre.0 Request processed in 160us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123323.037899:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 92 00000100:00100000:1.0:1789123323.041533:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123323.041694:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364510848 00000100:00100000:3.0:1789123323.041702:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364510848 00000100:00100000:3.0:1789123323.041756:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 93 00000100:00100000:3.0:1789123323.041767:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e75c46a1-b06d-458e-9df3-84f8d5648d06+11:14071:x1876031364510848:12345-192.168.206.30@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789123323.042100:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e75c46a1-b06d-458e-9df3-84f8d5648d06+11:14071:x1876031364510848:12345-192.168.206.30@tcp:501:mount.lustre.0 Request processed in 334us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123323.042109:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 93 00000100:00100000:0.0:1789123323.048005:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123323.048073:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364510976 00000100:00100000:2.0:1789123323.048084:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364510976 00000100:00100000:2.0:1789123323.048175:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 94 00000100:00100000:2.0:1789123323.048185:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e75c46a1-b06d-458e-9df3-84f8d5648d06+11:14071:x1876031364510976:12345-192.168.206.30@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789123323.048525:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e75c46a1-b06d-458e-9df3-84f8d5648d06+11:14071:x1876031364510976:12345-192.168.206.30@tcp:503:mount.lustre.0 Request processed in 340us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123323.048540:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 94 00000100:00100000:0.0:1789123323.054499:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123323.054598:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364511104 00000100:00100000:1.0:1789123323.054608:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364511104 00000100:00100000:1.0:1789123323.054694:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 95 00000100:00100000:1.0:1789123323.054703:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e75c46a1-b06d-458e-9df3-84f8d5648d06+11:14077:x1876031364511104:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789123323.055063:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e75c46a1-b06d-458e-9df3-84f8d5648d06+11:14077:x1876031364511104:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 360us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123323.055071:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 95 00000100:00100000:1.0:1789123323.077753:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123323.078361:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364511232 00000100:00100000:2.0:1789123323.078374:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364511232 00000100:00100000:2.0:1789123323.078433:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 96 00000100:00100000:2.0:1789123323.078445:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e75c46a1-b06d-458e-9df3-84f8d5648d06+11:14077:x1876031364511232:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789123323.080508:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e75c46a1-b06d-458e-9df3-84f8d5648d06+11:14077:x1876031364511232:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 2047us (2750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123323.080526:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 96 00000100:00100000:0.0:1789123323.090580:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123323.091322:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364511360 00000100:00100000:3.0:1789123323.091337:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364511360 00000100:00100000:3.0:1789123323.091400:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 97 00000100:00100000:3.0:1789123323.091411:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e75c46a1-b06d-458e-9df3-84f8d5648d06+11:14071:x1876031364511360:12345-192.168.206.30@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789123323.091427:0:14666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123323.091446:0:14666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3402fbbc00/0x7e1648d68fc92f2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f9a9 expref: -99 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123323.091479:0:14666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3402fbbc00/0x7e1648d68fc92f2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9a9 expref: 12 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123323.091489:0:14666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3402fbbc00/0x7e1648d68fc92f2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9a9 expref: 12 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123323.091499:0:14666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbbc00, rc 0) 00000100:00100000:3.0:1789123323.091572:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e75c46a1-b06d-458e-9df3-84f8d5648d06+12:14071:x1876031364511360:12345-192.168.206.30@tcp:101:mount.lustre.0 Request processed in 163us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123323.091579:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 97 00000100:00100000:0.0:1789123323.101622:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123323.104277:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364511488 00000100:00100000:2.0:1789123323.104292:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364511488 00000100:00100000:2.0:1789123323.104416:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 98 00000100:00100000:2.0:1789123323.104426:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343bf12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e75c46a1-b06d-458e-9df3-84f8d5648d06+12:14071:x1876031364511488:12345-192.168.206.30@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789123323.104616:0:14665:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789123323.104763:0:14665:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789123323.104768:0:14665:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789123323.104771:0:14665:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789123323.104825:0:14665:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789123323.106724:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343bf12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e75c46a1-b06d-458e-9df3-84f8d5648d06+12:14071:x1876031364511488:12345-192.168.206.30@tcp:256:mount.lustre.0 Request processed in 2291us (5106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123323.106737:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 98 00000100:00100000:0.0:1789123323.114261:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123323.114450:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364511616 00000100:00100000:1.0:1789123323.114459:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364511616 00000100:00100000:1.0:1789123323.114513:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 99 00000100:00100000:1.0:1789123323.114524:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343bf11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e75c46a1-b06d-458e-9df3-84f8d5648d06+12:14071:x1876031364511616:12345-192.168.206.30@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789123323.114681:0:14663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123323.114699:0:14663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3401514e00/0x7e1648d68fc92f32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f9b0 expref: -99 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123323.114727:0:14663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3401514e00/0x7e1648d68fc92f32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9b0 expref: 13 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123323.114738:0:14663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3401514e00/0x7e1648d68fc92f32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9b0 expref: 13 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123323.114748:0:14663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3401514e00, rc 0) 00000100:00100000:1.0:1789123323.114844:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343bf11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e75c46a1-b06d-458e-9df3-84f8d5648d06+13:14071:x1876031364511616:12345-192.168.206.30@tcp:101:mount.lustre.0 Request processed in 321us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123323.114865:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 99 00000100:00100000:0.0:1789123323.117308:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123323.117407:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364511744 00000100:00100000:2.0:1789123323.117416:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364511744 00000100:00100000:2.0:1789123323.117509:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 100 00000100:00100000:2.0:1789123323.117521:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343bf10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e75c46a1-b06d-458e-9df3-84f8d5648d06+13:14071:x1876031364511744:12345-192.168.206.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789123323.117850:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343bf10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e75c46a1-b06d-458e-9df3-84f8d5648d06+13:14071:x1876031364511744:12345-192.168.206.30@tcp:501:mount.lustre.0 Request processed in 329us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123323.117865:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 100 00000100:00100000:0.0:1789123323.121316:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123323.121397:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364511872 00000100:00100000:1.0:1789123323.121406:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364511872 00000100:00100000:1.0:1789123323.121460:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 101 00000100:00100000:1.0:1789123323.121470:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343bf10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e75c46a1-b06d-458e-9df3-84f8d5648d06+13:14071:x1876031364511872:12345-192.168.206.30@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789123323.121816:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343bf10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e75c46a1-b06d-458e-9df3-84f8d5648d06+13:14071:x1876031364511872:12345-192.168.206.30@tcp:503:mount.lustre.0 Request processed in 347us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123323.121824:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 101 00000100:00100000:0.0:1789123323.127837:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123323.128451:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364512000 00000100:00100000:2.0:1789123323.128466:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364512000 00000100:00100000:2.0:1789123323.128545:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 102 00000100:00100000:2.0:1789123323.128558:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343bf12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e75c46a1-b06d-458e-9df3-84f8d5648d06+13:14081:x1876031364512000:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789123323.129024:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343bf12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e75c46a1-b06d-458e-9df3-84f8d5648d06+13:14081:x1876031364512000:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 467us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123323.129034:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 102 00000100:00100000:0.0:1789123323.135713:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123323.135796:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364512128 00000100:00100000:1.0:1789123323.135812:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364512128 00000100:00100000:1.0:1789123323.135896:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 103 00000100:00100000:1.0:1789123323.135906:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343bf13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e75c46a1-b06d-458e-9df3-84f8d5648d06+13:14081:x1876031364512128:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789123323.136177:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343bf13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e75c46a1-b06d-458e-9df3-84f8d5648d06+13:14081:x1876031364512128:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 271us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123323.136185:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 103 00000100:00100000:0.0:1789123323.144394:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123323.144489:0:14671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364512256 00000100:00100000:1.0:1789123323.144499:0:14671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364512256 00000100:00100000:1.0:1789123323.144543:0:14671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 10 00000100:00100000:1.0:1789123323.144555:0:14671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2351:x1876031364512256:12345-192.168.206.30@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789123323.144582:0:14671:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from afe1caaf-a00a-4897-8c78-69bf8bb551ac@192.168.206.30@tcp t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:1.0:1789123323.144666:0:14671:0:(genops.c:1385:class_connect()) connect: client afe1caaf-a00a-4897-8c78-69bf8bb551ac, cookie 0x7e1648d68fc92f39 00000004:00100000:1.0:1789123323.144696:0:14671:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789123323.144810:0:14671:0:(import.c:65:import_set_state_nolock()) ffff9f3301f47800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789123323.144883:0:14671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:afe1caaf-a00a-4897-8c78-69bf8bb551ac+6:2351:x1876031364512256:12345-192.168.206.30@tcp:38:mount.lustre.0 Request processed in 331us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123323.144905:0:14671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 10 00000100:00100000:0.0:1789123323.149202:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123323.149292:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364512384 00000100:00100000:2.0:1789123323.149304:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364512384 00000100:00100000:2.0:1789123323.149371:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 11 00000100:00100000:2.0:1789123323.149382:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:afe1caaf-a00a-4897-8c78-69bf8bb551ac+6:0:x1876031364512384:12345-192.168.206.30@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789123323.149413:0:14670:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789123323.149495:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b4ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:afe1caaf-a00a-4897-8c78-69bf8bb551ac+6:0:x1876031364512384:12345-192.168.206.30@tcp:41:mount.lustre.0 Request processed in 115us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123323.149502:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 11 00000100:00100000:3.0:1789123323.150729:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123323.150760:0:14671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364512512 00000100:00100000:1.0:1789123323.150767:0:14671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364512512 00000100:00100000:1.0:1789123323.150824:0:14671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 12 00000100:00100000:1.0:1789123323.150834:0:14671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:afe1caaf-a00a-4897-8c78-69bf8bb551ac+6:14071:x1876031364512512:12345-192.168.206.30@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789123323.150857:0:14671:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789123323.150906:0:14671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:afe1caaf-a00a-4897-8c78-69bf8bb551ac+6:14071:x1876031364512512:12345-192.168.206.30@tcp:41:mount.lustre.0 Request processed in 74us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123323.150914:0:14671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 12 00000100:00080000:0.0:1789123323.151039:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789123323.154280:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123323.154476:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364512640 00000100:00100000:0.0:1789123323.154485:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364512640 00000100:00100000:0.0:1789123323.154542:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 13 00000100:00100000:0.0:1789123323.154552:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f33035aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:afe1caaf-a00a-4897-8c78-69bf8bb551ac+6:14071:x1876031364512640:12345-192.168.206.30@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789123323.154670:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f33035aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:afe1caaf-a00a-4897-8c78-69bf8bb551ac+6:14071:x1876031364512640:12345-192.168.206.30@tcp:40:mount.lustre.0 Request processed in 120us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123323.154678:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 13 00000100:00100000:2.0:1789123323.158886:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123323.158922:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123323.158952:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123323.159093:0:14674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364513024 00000100:00100000:3.0:1789123323.159124:0:14674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364513024 00000100:00100000:0.0:1789123323.159141:0:15956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364512768 00000100:00100000:0.0:1789123323.159145:0:15956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364512768 00000100:00100000:0.0:1789123323.159164:0:15956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364512896 00000100:00100000:0.0:1789123323.159166:0:15956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364512896 00000100:00100000:3.0:1789123323.159173:0:14674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 1 00000100:00100000:0.0:1789123323.159178:0:15956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 10 00000100:00100000:3.0:1789123323.159181:0:14674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:afe1caaf-a00a-4897-8c78-69bf8bb551ac+6:14071:x1876031364513024:12345-192.168.206.30@tcp:33:mount.lustre.0 00000100:00100000:0.0:1789123323.159183:0:15956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1876031364512768:12345-192.168.206.30@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789123323.159211:0:15956:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from afe1caaf-a00a-4897-8c78-69bf8bb551ac@192.168.206.30@tcp t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:0.0:1789123323.159245:0:15956:0:(genops.c:1385:class_connect()) connect: client afe1caaf-a00a-4897-8c78-69bf8bb551ac, cookie 0x7e1648d68fc92f40 00002000:00100000:0.0:1789123323.159255:0:15956:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli afe1caaf-a00a-4897-8c78-69bf8bb551ac/ffff9f3303513800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789123323.159265:0:15956:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789123323.159373:0:15956:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789123323.159403:0:15956:0:(import.c:65:import_set_state_nolock()) ffff9f3303514800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789123323.159466:0:15956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:afe1caaf-a00a-4897-8c78-69bf8bb551ac+6:2351:x1876031364512768:12345-192.168.206.30@tcp:8:mount.lustre.0 Request processed in 281us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123323.159473:0:15956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 10 00000004:00200000:3.0:1789123323.159486:0:14674:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1789123323.159489:0:15956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 11 00000100:00100000:0.0:1789123323.159493:0:15956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1876031364512896:12345-192.168.206.30@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789123323.159506:0:15956:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from afe1caaf-a00a-4897-8c78-69bf8bb551ac@192.168.206.30@tcp t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:0.0:1789123323.159523:0:15956:0:(genops.c:1385:class_connect()) connect: client afe1caaf-a00a-4897-8c78-69bf8bb551ac, cookie 0x7e1648d68fc92f47 00002000:00100000:0.0:1789123323.159528:0:15956:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli afe1caaf-a00a-4897-8c78-69bf8bb551ac/ffff9f3303510000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789123323.159534:0:15956:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789123323.159604:0:14674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:afe1caaf-a00a-4897-8c78-69bf8bb551ac+6:14071:x1876031364513024:12345-192.168.206.30@tcp:33:mount.lustre.0 Request processed in 423us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123323.159612:0:14674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 1 00002000:00080000:0.0:1789123323.159949:0:15956:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789123323.159967:0:15956:0:(import.c:65:import_set_state_nolock()) ffff9f3303516800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789123323.160047:0:15956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:afe1caaf-a00a-4897-8c78-69bf8bb551ac+6:2351:x1876031364512896:12345-192.168.206.30@tcp:8:mount.lustre.0 Request processed in 551us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123323.160066:0:15956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 11 00000100:00100000:2.0:1789123323.350775:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123323.355250:0:14671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364513152 00000100:00100000:1.0:1789123323.355265:0:14671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364513152 00000100:00100000:1.0:1789123323.355448:0:14671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 14 00000100:00100000:1.0:1789123323.355459:0:14671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:afe1caaf-a00a-4897-8c78-69bf8bb551ac+6:14103:x1876031364513152:12345-192.168.206.30@tcp:101:mkdir.0 00010000:00010000:1.0:1789123323.355478:0:14671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123323.355499:0:14671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514000/0x7e1648d68fc92f4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f9da expref: -99 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123323.355563:0:14671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc92f55 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123323.355578:0:14671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc92f55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123323.355590:0:14671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc92f55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123323.355846:0:14671:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789123323.355851:0:14671:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1789123323.355927:0:14671:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc92f55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123323.355965:0:14671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514000/0x7e1648d68fc92f4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9da expref: 8 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123323.355983:0:14671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc92f55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9da expref: 7 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123323.355997:0:14671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f3409cd8e00) 00010000:00010000:1.0:1789123323.356000:0:14671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789123323.356003:0:14671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3401515e00, rc 0) 00000100:00100000:1.0:1789123323.356070:0:14671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:afe1caaf-a00a-4897-8c78-69bf8bb551ac+7:14103:x1876031364513152:12345-192.168.206.30@tcp:101:mkdir.0 Request processed in 613us (5304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123323.356077:0:14671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 14 00000001:00100000:1.0:1789123323.468673:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of afe1caaf-a00a-4897-8c78-69bf8bb551ac 00000001:00100000:1.0:1789123323.468690:0:6710:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d3970986-6c0c-4726-808e-9ec9e5a9682c 00010000:00010000:0.0:1789123324.040399:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123325.061338:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123325.445201:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789123325.445235:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343585e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381282432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789123325.445337:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123325.445965:0:15359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381282432 00000100:00100000:1.0:1789123325.445978:0:15359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381282432 00000100:00100000:1.0:1789123325.446061:0:15359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789123325.446072:0:15359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381282432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789123325.446118:0:15359:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789123325.446186:0:15359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381282432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123325.446206:0:15359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1789123325.446404:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789123325.447080:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343585e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381282432:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1789123325.525463:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of afe1caaf-a00a-4897-8c78-69bf8bb551ac 00000001:00100000:2.0:1789123325.525484:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d3970986-6c0c-4726-808e-9ec9e5a9682c 00000001:02000400:2.0:1789123326.081876:0:16639:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789123326.085929:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789123326.533396:0:14707:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789123327.109228:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123327.497542:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062c9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381282816:0@lo:400:kworker.0 00000100:00100000:2.0:1789123327.497614:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123327.497690:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876031381283328:0@lo:400:kworker.0 00000100:00100000:2.0:1789123327.497715:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123327.497741:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789123327.497746:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381282944:0@lo:400:kworker.0 00000100:00100000:2.0:1789123327.497766:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123327.497794:0:15355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381282816 00000100:00100000:2.0:1789123327.497800:0:15355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381282816 00000100:00100000:2.0:1789123327.497853:0:15355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381282944 00000100:00100000:2.0:1789123327.497857:0:15355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381282944 00000100:00100000:2.0:1789123327.497884:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789123327.497894:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381282816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123327.497947:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381282816:12345-0@lo:400:kworker.0 Request processed in 55us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123327.497955:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789123327.497975:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789123327.497984:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381282944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123327.498019:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381282944:12345-0@lo:400:kworker.0 Request processed in 38us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123327.498024:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789123327.498045:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381283328 00000100:00100000:2.0:1789123327.498056:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381283328 00000100:00100000:2.0:1789123327.498094:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789123327.498103:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876031381283328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789123327.498149:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876031381283328:12345-0@lo:400:kworker.0 Request processed in 45us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123327.498156:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1789123327.498178:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789123327.498182:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b4b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381282560:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789123327.498184:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789123327.498189:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789123327.498572:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789123327.498590:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381282944:0@lo:400:kworker.0 00000100:00100000:2.0:1789123327.498603:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062c9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381282816:0@lo:400:kworker.0 00000100:00100000:2.0:1789123327.498611:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876031381283328:0@lo:400:kworker.0 00000100:00100000:0.0:1789123327.499047:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123327.499101:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876031381283072:0@lo:400:kworker.0 00000100:00100000:0.0:1789123327.499157:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123327.499194:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789123327.499203:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062cb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39ef4522-e133-4b32-b80c-ca92d5b19344:3304:1876031381282688:0@lo:400:kworker.0 00000100:00100000:0.0:1789123327.499236:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123327.499274:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381283200:0@lo:400:kworker.0 00000100:00100000:0.0:1789123327.499300:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123327.499363:0:15359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381282560 00000100:00100000:0.0:1789123327.499370:0:15359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381282560 00000100:00100000:0.0:1789123327.499428:0:15359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789123327.499439:0:15359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381282560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789123327.499485:0:15359:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789123327.499543:0:15359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381282560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123327.499555:0:15359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789123327.499564:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381282688 00000100:00100000:3.0:1789123327.499576:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381282688 00000100:00100000:0.0:1789123327.499594:0:16551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381283072 00000100:00100000:0.0:1789123327.499601:0:16551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381283072 00000100:00100000:3.0:1789123327.499663:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789123327.499678:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343bf11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+19:3304:x1876031381282688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123327.499680:0:16551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381283200 00000100:00100000:0.0:1789123327.499692:0:16551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381283200 00000100:00100000:0.0:1789123327.499734:0:16551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789123327.499758:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343bf11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+19:3304:x1876031381282688:12345-0@lo:400:kworker.0 Request processed in 83us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123327.499760:0:16551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876031381283072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123327.499781:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789123327.499830:0:16551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876031381283072:12345-0@lo:400:kworker.0 Request processed in 72us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123327.499841:0:16551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789123327.499861:0:16551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789123327.499874:0:16551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381283200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123327.499906:0:16551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381283200:12345-0@lo:400:kworker.0 Request processed in 39us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123327.499914:0:16551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789123327.501457:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062cb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39ef4522-e133-4b32-b80c-ca92d5b19344:3304:1876031381282688:0@lo:400:kworker.0 00000100:00100000:0.0:1789123327.501483:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381283200:0@lo:400:kworker.0 00000100:00100000:0.0:1789123327.501517:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b4b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381282560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789123327.501531:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876031381283072:0@lo:400:kworker.0 00000100:00080000:2.0:1789123327.502555:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1789123327.541506:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of afe1caaf-a00a-4897-8c78-69bf8bb551ac 00010000:00010000:0.0:1789123328.133519:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789123328.415210:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123328.415326:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123328.415366:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123328.415391:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123328.415411:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123328.415430:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123328.415453:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123328.415681:0:15355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364513536 00000100:00100000:1.0:1789123328.415693:0:15355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364513536 00000100:00100000:1.0:1789123328.415758:0:15355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364514048 00000100:00100000:1.0:1789123328.415762:0:15355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364514048 00000100:00100000:1.0:1789123328.415778:0:15355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364513664 00000100:00100000:1.0:1789123328.415780:0:15355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364513664 00000100:00100000:1.0:1789123328.415793:0:15355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364513920 00000100:00100000:1.0:1789123328.415796:0:15355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364513920 00000100:00100000:1.0:1789123328.415815:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 6 00000100:00100000:1.0:1789123328.415825:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f33035a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+5:2355:x1876031364513536:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123328.415920:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f33035a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+5:2355:x1876031364513536:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 95us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123328.416057:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 6 00000100:00100000:1.0:1789123328.416078:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:1.0:1789123328.416085:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3420dbf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:afe1caaf-a00a-4897-8c78-69bf8bb551ac+5:2355:x1876031364514048:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123328.416115:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3420dbf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:afe1caaf-a00a-4897-8c78-69bf8bb551ac+5:2355:x1876031364514048:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 31us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123328.416121:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:1.0:1789123328.416152:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 8 00000100:00100000:1.0:1789123328.416157:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+5:2355:x1876031364513664:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123328.416180:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+5:2355:x1876031364513664:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 24us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123328.416186:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 8 00000100:00100000:1.0:1789123328.416195:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00100000:1.0:1789123328.416201:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:afe1caaf-a00a-4897-8c78-69bf8bb551ac+5:2355:x1876031364513920:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123328.416221:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:afe1caaf-a00a-4897-8c78-69bf8bb551ac+5:2355:x1876031364513920:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 21us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123328.416227:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00100000:1.0:1789123328.416310:0:16551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364513792 00000100:00100000:1.0:1789123328.416315:0:16551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364513792 00000100:00100000:1.0:1789123328.416346:0:16551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364513408 00000100:00100000:1.0:1789123328.416349:0:16551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364513408 00000100:00100000:1.0:1789123328.416367:0:16551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 19 00000100:00100000:1.0:1789123328.416373:0:16551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f33035a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:afe1caaf-a00a-4897-8c78-69bf8bb551ac+6:2355:x1876031364513792:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123328.416982:0:16551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f33035a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:afe1caaf-a00a-4897-8c78-69bf8bb551ac+6:2355:x1876031364513792:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 606us (1612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123328.416991:0:16551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 19 00000100:00100000:1.0:1789123328.417010:0:16551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 20 00000100:00100000:1.0:1789123328.417017:0:16551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+6:2354:x1876031364513408:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123328.417044:0:16551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+6:2354:x1876031364513408:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 29us (1590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123328.417051:0:16551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 20 00000100:00100000:2.0:1789123328.419542:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364513280 00000100:00100000:2.0:1789123328.419562:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364513280 00000100:00100000:2.0:1789123328.419674:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 105 00000100:00100000:2.0:1789123328.419688:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343bf10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e75c46a1-b06d-458e-9df3-84f8d5648d06+13:2353:x1876031364513280:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1789123328.419796:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343bf10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e75c46a1-b06d-458e-9df3-84f8d5648d06+13:2353:x1876031364513280:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 110us (4720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123328.419804:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 105 00000100:00080000:2.0:1789123328.419847:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789123328.419855:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789123328.419858:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1789123329.061258:0:16789:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa1d66050 20000000:00000080:2.0:1789123329.061280:0:16789:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f3303017000 uarg=0000000000000000 20000000:01000000:2.0:1789123329.061328:0:16789:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789123329.061341:0:16789:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789123329.061346:0:16789:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789123329.062611:0:16790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1789123329.063067:0:16789:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789123329.080909:0:16789:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789123329.082108:0:16789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f3435b53600/0x7e1648d68fc92f5c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.082142:0:16789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f342d80b000/0x7e1648d68fc92c53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc92c4c expref: 18 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.082152:0:16789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f3402fbae00/0x7e1648d68fc92ca0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc92c99 expref: 18 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.082160:0:16789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f3303948e00/0x7e1648d68fc92ddb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc92dd4 expref: 18 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.082195:0:16789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f3401515600/0x7e1648d68fc92efa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f94e expref: 12 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.082202:0:16789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f3401514e00/0x7e1648d68fc92f32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9b0 expref: 12 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.082211:0:16789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f3435b53600/0x7e1648d68fc92f5c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.082276:0:16789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f3401514e00/0x7e1648d68fc92f32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9b0 expref: 12 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.082296:0:16789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f3401514e00/0x7e1648d68fc92f32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9b0 expref: 12 pid: 14663 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123329.082316:0:16789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b4b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16789:1876031381283456:192.168.206.30@tcp:104: 00010000:00010000:0.0:1789123329.082485:0:16789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f3401515600/0x7e1648d68fc92efa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f94e expref: 12 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.082495:0:16789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f3401515600/0x7e1648d68fc92efa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f94e expref: 12 pid: 14663 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123329.082505:0:16789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b4bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16789:1876031381283584:192.168.206.30@tcp:104: 00010000:00010000:0.0:1789123329.082540:0:16789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f3303948e00/0x7e1648d68fc92ddb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc92dd4 expref: 18 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.082550:0:16789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f3303948e00/0x7e1648d68fc92ddb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc92dd4 expref: 18 pid: 14663 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123329.082575:0:16789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b48b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16789:1876031381283712:0@lo:104: 00000100:00100000:0.0:1789123329.082699:0:16789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123329.082770:0:14654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381283712 00000100:00100000:0.0:1789123329.082779:0:14654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381283712 00000100:00100000:0.0:1789123329.082851:0:14654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789123329.082862:0:14654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39ef4522-e133-4b32-b80c-ca92d5b19344+3:16789:x1876031381283712:12345-0@lo:104: 00010000:00010000:0.0:1789123329.082879:0:14654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f342d80a200/0x7e1648d68fc92dd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc92ddb expref: -99 pid: 16074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.082936:0:14654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789123329.082943:0:14654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39ef4522-e133-4b32-b80c-ca92d5b19344+3:16789:x1876031381283712:12345-0@lo:104: Request processed in 83us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123329.082952:0:14654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789123329.082994:0:16789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f3402fbae00/0x7e1648d68fc92ca0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc92c99 expref: 18 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.083004:0:16789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f3402fbae00/0x7e1648d68fc92ca0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc92c99 expref: 18 pid: 14665 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123329.083012:0:16789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b49680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16789:1876031381283840:0@lo:104: 00000100:00100000:0.0:1789123329.083038:0:16789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123329.083057:0:14654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381283840 00000100:00100000:0.0:1789123329.083061:0:14654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381283840 00000100:00100000:0.0:1789123329.083077:0:14654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789123329.083083:0:14654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b483c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39ef4522-e133-4b32-b80c-ca92d5b19344+3:16789:x1876031381283840:12345-0@lo:104: 00010000:00010000:0.0:1789123329.083098:0:14654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f343bd33600/0x7e1648d68fc92c99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc92ca0 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.083146:0:14654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789123329.083151:0:14654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b483c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39ef4522-e133-4b32-b80c-ca92d5b19344+3:16789:x1876031381283840:12345-0@lo:104: Request processed in 68us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123329.083158:0:14654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789123329.083176:0:14660:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789123329.083183:0:14660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f342d80a200/0x7e1648d68fc92dd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc92ddb expref: -99 pid: 16074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.083192:0:14660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a200 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:0.0:1789123329.083198:0:14660:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f342d80a200/0x7e1648d68fc92dd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc92ddb expref: -99 pid: 16074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.083208:0:14660:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f342d80a200/0x7e1648d68fc92dd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc92ddb expref: -99 pid: 16074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789123329.083218:0:14660:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f342d80a200/0x7e1648d68fc92dd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc92ddb expref: -99 pid: 16074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789123329.083225:0:14660:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789123329.083264:0:14660:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f342d80a200/0x7e1648d68fc92dd4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc92ddb expref: -99 pid: 16074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.083272:0:14660:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789123329.083294:0:14660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f342d80a200/0x7e1648d68fc92dd4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc92ddb expref: -99 pid: 16074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.083302:0:14660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f342d80a200/0x7e1648d68fc92dd4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc92ddb expref: -99 pid: 16074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.083330:0:14660:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789123329.083334:0:14660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f343bd33600/0x7e1648d68fc92c99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc92ca0 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.083341:0:14660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f343bd33600 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:0.0:1789123329.083344:0:14660:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f343bd33600/0x7e1648d68fc92c99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc92ca0 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.083352:0:14660:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f343bd33600/0x7e1648d68fc92c99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc92ca0 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789123329.083359:0:14660:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f343bd33600/0x7e1648d68fc92c99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc92ca0 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789123329.083364:0:14660:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789123329.083379:0:14660:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f343bd33600/0x7e1648d68fc92c99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc92ca0 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.083385:0:14660:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789123329.083414:0:14660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f343bd33600/0x7e1648d68fc92c99 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc92ca0 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.083422:0:14660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f343bd33600/0x7e1648d68fc92c99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc92ca0 expref: -99 pid: 15353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.083433:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123329.083435:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123329.083437:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123329.083461:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789123329.083485:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39ef4522-e133-4b32-b80c-ca92d5b19344:3305:1876031381284096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789123329.083519:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789123329.083570:0:16789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f342d80b000/0x7e1648d68fc92c53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7e1648d68fc92c4c expref: 18 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.083581:0:16789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f342d80b000/0x7e1648d68fc92c53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7e1648d68fc92c4c expref: 18 pid: 14666 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123329.083589:0:16789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b4a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16789:1876031381284224:0@lo:104: 00000100:00100000:0.0:1789123329.083646:0:16789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123329.083677:0:14654:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789123329.083687:0:14654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381284224 00000100:00100000:0.0:1789123329.083691:0:14654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381284224 00000100:00100000:0.0:1789123329.083713:0:14654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789123329.083720:0:14654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3406794c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39ef4522-e133-4b32-b80c-ca92d5b19344+3:16789:x1876031381284224:12345-0@lo:104: 00010000:00010000:0.0:1789123329.083729:0:14654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9f3435b52e00/0x7e1648d68fc92c4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc92c53 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.083762:0:14654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789123329.083767:0:14654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3406794c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39ef4522-e133-4b32-b80c-ca92d5b19344+3:16789:x1876031381284224:12345-0@lo:104: Request processed in 48us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123329.083774:0:14654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789123329.083815:0:14660:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789123329.083819:0:14660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9f3435b52e00/0x7e1648d68fc92c4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7e1648d68fc92c53 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.083826:0:14660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52e00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:0.0:1789123329.083829:0:14660:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9f3435b52e00/0x7e1648d68fc92c4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7e1648d68fc92c53 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.083847:0:14660:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9f3435b52e00/0x7e1648d68fc92c4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7e1648d68fc92c53 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789123329.083855:0:14660:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9f3435b52e00/0x7e1648d68fc92c4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7e1648d68fc92c53 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789123329.083861:0:14660:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789123329.083879:0:14660:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9f3435b52e00/0x7e1648d68fc92c4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc92c53 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.083885:0:14660:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789123329.083896:0:14660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9f3435b52e00/0x7e1648d68fc92c4c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc92c53 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.083902:0:14660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9f3435b52e00/0x7e1648d68fc92c4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7e1648d68fc92c53 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.083917:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123329.083919:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789123329.083920:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123329.083935:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39ef4522-e133-4b32-b80c-ca92d5b19344:3305:1876031381284352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789123329.083963:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123329.084000:0:14656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381284096 00000100:00100000:0.0:1789123329.084004:0:14656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381284096 00010000:00010000:0.0:1789123329.084024:0:14656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f3402fbae00/0x7e1648d68fc92ca0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc92c99 expref: 19 pid: 14665 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123329.084042:0:14656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381284352 00000100:00100000:0.0:1789123329.084045:0:14656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381284352 00010000:00010000:0.0:1789123329.084067:0:14656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f342d80b000/0x7e1648d68fc92c53 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc92c4c expref: 20 pid: 14666 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123329.084081:0:14656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789123329.084087:0:14656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b49a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39ef4522-e133-4b32-b80c-ca92d5b19344+20:3305:x1876031381284096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789123329.084099:0:14656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123329.084104:0:14656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f3402fbae00/0x7e1648d68fc92ca0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc92c99 expref: 20 pid: 14665 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.084114:0:14656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f3402fbae00/0x7e1648d68fc92ca0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc92c99 expref: 20 pid: 14665 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.084132:0:14656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123329.084161:0:14656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b49a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39ef4522-e133-4b32-b80c-ca92d5b19344+20:3305:x1876031381284096:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123329.084167:0:14656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789123329.084181:0:14656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789123329.084187:0:14656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b483c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39ef4522-e133-4b32-b80c-ca92d5b19344+19:3305:x1876031381284352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789123329.084194:0:14656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123329.084198:0:14656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f342d80b000/0x7e1648d68fc92c53 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc92c4c expref: 19 pid: 14666 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.084205:0:14656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f342d80b000/0x7e1648d68fc92c53 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc92c4c expref: 19 pid: 14666 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.084215:0:14656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789123329.084237:0:14656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b483c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39ef4522-e133-4b32-b80c-ca92d5b19344+19:3305:x1876031381284352:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123329.084243:0:14656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789123329.084288:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39ef4522-e133-4b32-b80c-ca92d5b19344:3305:1876031381284352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789123329.084297:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39ef4522-e133-4b32-b80c-ca92d5b19344:3305:1876031381284096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789123329.084323:0:16789:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3402be2000 going to sleep for 11 seconds 00000100:00100000:0.0:1789123329.084336:0:16789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b48b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16789:1876031381283712:0@lo:104: 00010000:00010000:0.0:1789123329.084346:0:16789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3402fbae00/0x7e1648d68fc92ca0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc92c99 expref: 18 pid: 14665 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123329.084355:0:16789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b49680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16789:1876031381283840:0@lo:104: 00010000:00010000:0.0:1789123329.084363:0:16789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f342d80b000/0x7e1648d68fc92c53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc92c4c expref: 17 pid: 14666 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123329.084371:0:16789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b4a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16789:1876031381284224:0@lo:104: 00010000:00010000:2.0:1789123329.084717:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123329.084725:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789123329.084739:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39ef4522-e133-4b32-b80c-ca92d5b19344:3302:1876031381283968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789123329.084779:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123329.084819:0:14657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381283968 00000100:00100000:2.0:1789123329.084823:0:14657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381283968 00010000:00010000:2.0:1789123329.084843:0:14657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f3303948e00/0x7e1648d68fc92ddb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc92dd4 expref: 17 pid: 14663 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123329.084859:0:14657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789123329.084866:0:14657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f330130bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39ef4522-e133-4b32-b80c-ca92d5b19344+17:3302:x1876031381283968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789123329.084875:0:14657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123329.084879:0:14657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f3303948e00/0x7e1648d68fc92ddb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7e1648d68fc92dd4 expref: 17 pid: 14663 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123329.084887:0:14657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f3303948e00/0x7e1648d68fc92ddb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7e1648d68fc92dd4 expref: 17 pid: 14663 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123329.084899:0:14657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3303948e00/0x7e1648d68fc92ddb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7e1648d68fc92dd4 expref: 17 pid: 14663 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123329.084910:0:14657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123329.084937:0:14657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f330130bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39ef4522-e133-4b32-b80c-ca92d5b19344+16:3302:x1876031381283968:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123329.084944:0:14657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789123329.085011:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39ef4522-e133-4b32-b80c-ca92d5b19344:3302:1876031381283968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789123329.094176:0:16789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b4b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16789:1876031381283456:192.168.206.30@tcp:104: 00000100:00100000:1.0:1789123329.094202:0:16789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b4bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16789:1876031381283584:192.168.206.30@tcp:104: 00010000:00010000:1.0:1789123329.094264:0:16789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f3435b53600/0x7e1648d68fc92f5c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123329.098842:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123329.099005:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123329.100067:0:14657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364514304 00000100:00100000:2.0:1789123329.100084:0:14657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364514304 00010000:00010000:2.0:1789123329.100141:0:14657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f3401515600/0x7e1648d68fc92efa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f94e expref: 13 pid: 14663 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123329.100212:0:14656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364514176 00000100:00100000:3.0:1789123329.100218:0:14656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364514176 00010000:00010000:3.0:1789123329.100239:0:14656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f3401514e00/0x7e1648d68fc92f32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9b0 expref: 14 pid: 14663 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123329.100318:0:14656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:3.0:1789123329.100330:0:14656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b48780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e75c46a1-b06d-458e-9df3-84f8d5648d06+14:2355:x1876031364514304:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789123329.100350:0:14656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123329.100356:0:14656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f3401515600/0x7e1648d68fc92efa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f94e expref: 14 pid: 14663 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123329.100393:0:14656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f3401515600/0x7e1648d68fc92efa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f94e expref: 14 pid: 14663 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123329.100419:0:14656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3401515600/0x7e1648d68fc92efa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f94e expref: 14 pid: 14663 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123329.100441:0:14656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123329.100664:0:14657:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789123329.100674:0:14657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1789123329.100813:0:14657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 8 00000100:00100000:2.0:1789123329.100821:0:14657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e75c46a1-b06d-458e-9df3-84f8d5648d06+13:2354:x1876031364514176:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789123329.100832:0:14657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123329.100837:0:14657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f3401514e00/0x7e1648d68fc92f32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9b0 expref: 13 pid: 14663 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123329.100848:0:14657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f3401514e00/0x7e1648d68fc92f32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9b0 expref: 13 pid: 14663 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123329.100859:0:14657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3401514e00/0x7e1648d68fc92f32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9b0 expref: 13 pid: 14663 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123329.100872:0:14657:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f3435b53600/0x7e1648d68fc92f5c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123329.100881:0:14657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3435b53600/0x7e1648d68fc92f5c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123329.100897:0:14657:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f3435b53600/0x7e1648d68fc92f5c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123329.100905:0:14657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f3435b53600/0x7e1648d68fc92f5c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123329.100937:0:14657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f3435b53600/0x7e1648d68fc92f5c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123329.100944:0:14657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f3435b53600/0x7e1648d68fc92f5c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123329.100951:0:14657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53600 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:2.0:1789123329.100955:0:14657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f3435b53600/0x7e1648d68fc92f5c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123329.100964:0:14657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f3435b53600/0x7e1648d68fc92f5c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123329.100980:0:14657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f3435b53600/0x7e1648d68fc92f5c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123329.100998:0:14657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789123329.101126:0:16789:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f3435b53600/0x7e1648d68fc92f5c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.101136:0:16789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f3435b53600/0x7e1648d68fc92f5c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123329.101142:0:16789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f3435b53600/0x7e1648d68fc92f5c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123329.101727:0:14656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b48780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e75c46a1-b06d-458e-9df3-84f8d5648d06+12:2355:x1876031364514304:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 1392us (2892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123329.101738:0:14656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:2.0:1789123329.104912:0:14657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e75c46a1-b06d-458e-9df3-84f8d5648d06+11:2354:x1876031364514176:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 4075us (5890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123329.104941:0:14657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 8 00010000:00010000:0.0:1789123329.158200:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123330.182447:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123330.565447:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343585c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381284480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789123330.565546:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123330.565915:0:15359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381284480 00000100:00100000:2.0:1789123330.565924:0:15359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381284480 00000100:00100000:2.0:1789123330.565995:0:15359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1789123330.566025:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789123330.566054:0:15359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381284480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789123330.566095:0:15359:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789123330.566191:0:15359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381284480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 187us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123330.566215:0:15359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789123330.573078:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343585c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381284480:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1789123330.630889:0:14668:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789123330.630897:0:14668:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f3408403800 from 13 10000000:01000000:3.0:1789123330.630902:0:14668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789123330.630945:0:14668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3402fba200/0x7e1648d68fc92f63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123330.630957:0:14668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f3402fba200/0x7e1648d68fc92f63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123330.630968:0:14668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f3402fba200/0x7e1648d68fc92f63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123330.630994:0:14668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34355fcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381284608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789123330.631069:0:14668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123330.631125:0:14668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f342d734180 going to sleep for 11 seconds 00000100:00100000:0.0:1789123330.631178:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381284608 00000100:00100000:0.0:1789123330.631186:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381284608 00000100:00100000:0.0:1789123330.631244:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789123330.631254:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3404997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+16:14668:x1876031381284608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789123330.631278:0:14663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123330.631292:0:14663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3435b52600/0x7e1648d68fc92f6a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc92f63 expref: -99 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123330.631316:0:14663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3435b52600/0x7e1648d68fc92f6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc92f63 expref: 17 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123330.631327:0:14663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3435b52600/0x7e1648d68fc92f6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc92f63 expref: 17 pid: 14663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123330.631336:0:14663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b52600, rc 0) 00000100:00100000:0.0:1789123330.631377:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3404997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+17:14668:x1876031381284608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123330.631385:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789123330.631430:0:14668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34355fcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381284608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789123330.631580:0:14668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f3402fba200/0x7e1648d68fc92f63 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92f6a expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123330.631591:0:14668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f3402fba200/0x7e1648d68fc92f63 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc92f6a expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123330.631808:0:14668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b4b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381284736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789123330.631836:0:14668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123330.631852:0:14668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f343c34f300 going to sleep for 11 seconds 00000100:00100000:0.0:1789123330.631866:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381284736 00000100:00100000:0.0:1789123330.631870:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381284736 00000100:00100000:0.0:1789123330.631892:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789123330.631899:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3404996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+17:14668:x1876031381284736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789123330.632147:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3404996c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+17:14668:x1876031381284736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123330.632155:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789123330.632187:0:14668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b4b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381284736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789123330.632217:0:14668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b4b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381284864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789123330.632253:0:14668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123330.632269:0:14668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f343c34f300 going to sleep for 11 seconds 00000100:00100000:0.0:1789123330.632281:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381284864 00000100:00100000:0.0:1789123330.632285:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381284864 00000100:00100000:0.0:1789123330.632306:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789123330.632311:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3404997450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+17:14668:x1876031381284864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789123330.633834:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3404997450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39ef4522-e133-4b32-b80c-ca92d5b19344+17:14668:x1876031381284864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123330.633846:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789123330.633904:0:14668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b4b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381284864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789123330.638270:0:16869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789123330.639343:0:14668:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789123330.639374:0:14668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789123330.639385:0:14668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f3402fba200/0x7e1648d68fc92f63 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92f6a expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123330.639398:0:14668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f3402fba200/0x7e1648d68fc92f63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92f6a expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123330.639408:0:14668:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789123330.639410:0:14668:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f3406272800 from 13 10000000:01000000:2.0:1789123330.639413:0:14668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789123330.639450:0:14668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f342d80aa00/0x7e1648d68fc92f71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123330.639458:0:14668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f342d80aa00/0x7e1648d68fc92f71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123330.639468:0:14668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f342d80aa00/0x7e1648d68fc92f71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123330.639493:0:14668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343585f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381284992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789123330.639558:0:14668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123330.639615:0:14668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340647c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789123330.640076:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381284992 00000100:00100000:3.0:1789123330.640090:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381284992 00000100:00100000:3.0:1789123330.640208:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789123330.640218:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3404994050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+17:14668:x1876031381284992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789123330.640230:0:14666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123330.640249:0:14666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3402fbb000/0x7e1648d68fc92f78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc92f71 expref: -99 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123330.640273:0:14666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3402fbb000/0x7e1648d68fc92f78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc92f71 expref: 18 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123330.640283:0:14666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3402fbb000/0x7e1648d68fc92f78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc92f71 expref: 18 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123330.640291:0:14666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbb000, rc 0) 00000100:00100000:3.0:1789123330.640344:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3404994050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+18:14668:x1876031381284992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123330.640350:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789123330.640417:0:14668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343585f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381284992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789123330.640432:0:14668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f342d80aa00/0x7e1648d68fc92f71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92f78 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123330.640442:0:14668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f342d80aa00/0x7e1648d68fc92f71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc92f78 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123330.640514:0:14668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343585f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381285120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789123330.640543:0:14668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123330.640969:0:14668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340647c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789123330.641027:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381285120 00000100:00100000:0.0:1789123330.641032:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381285120 00000100:00100000:0.0:1789123330.641056:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789123330.641063:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3404996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+18:14668:x1876031381285120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789123330.641328:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3404996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+18:14668:x1876031381285120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123330.641335:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789123330.641431:0:14668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343585f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381285120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789123330.641461:0:14668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343585f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381285248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789123330.641509:0:14668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123330.641526:0:14668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340647c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789123330.641622:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381285248 00000100:00100000:0.0:1789123330.641653:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381285248 00000100:00100000:0.0:1789123330.641689:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789123330.641702:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3404995450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+18:14668:x1876031381285248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789123330.642027:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3404995450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+18:14668:x1876031381285248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 325us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123330.642034:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789123330.642110:0:14668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343585f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381285248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789123330.643225:0:16870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789123330.643397:0:14668:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789123330.643420:0:14668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789123330.643430:0:14668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f342d80aa00/0x7e1648d68fc92f71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92f78 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123330.643441:0:14668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f342d80aa00/0x7e1648d68fc92f71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92f78 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789123330.643451:0:14668:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789123330.643453:0:14668:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f343fca3000 from 13 10000000:01000000:2.0:1789123330.643456:0:14668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789123330.643487:0:14668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f342d80a400/0x7e1648d68fc92f7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123330.643494:0:14668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9f342d80a400/0x7e1648d68fc92f7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123330.643572:0:14668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9f342d80a400/0x7e1648d68fc92f7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123330.643615:0:14668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343585f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381285376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789123330.643961:0:14668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123330.644005:0:14668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340622f300 going to sleep for 11 seconds 00000100:00100000:1.0:1789123330.644052:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381285376 00000100:00100000:1.0:1789123330.644058:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381285376 00000100:00100000:1.0:1789123330.644104:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789123330.644113:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3404994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+18:14668:x1876031381285376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789123330.644124:0:14666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123330.644136:0:14666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3401514600/0x7e1648d68fc92f86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7e1648d68fc92f7f expref: -99 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123330.644159:0:14666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3401514600/0x7e1648d68fc92f86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7e1648d68fc92f7f expref: 19 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123330.644170:0:14666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3401514600/0x7e1648d68fc92f86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7e1648d68fc92f7f expref: 19 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123330.644179:0:14666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3401514600, rc 0) 00000100:00100000:1.0:1789123330.644226:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3404994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+19:14668:x1876031381285376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123330.644233:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789123330.644319:0:14668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343585f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381285376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789123330.644331:0:14668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9f342d80a400/0x7e1648d68fc92f7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92f86 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123330.644340:0:14668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9f342d80a400/0x7e1648d68fc92f7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7e1648d68fc92f86 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123330.644382:0:14668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343585f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381285504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789123330.644406:0:14668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789123330.644427:0:14668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340622f300 going to sleep for 11 seconds 00000100:00100000:1.0:1789123330.644462:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381285504 00000100:00100000:1.0:1789123330.644474:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381285504 00000100:00100000:2.0:1789123330.644585:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789123330.644594:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3436f5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+19:14668:x1876031381285504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789123330.645159:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3436f5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39ef4522-e133-4b32-b80c-ca92d5b19344+19:14668:x1876031381285504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 566us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123330.645167:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789123330.645262:0:14668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343585f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381285504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789123330.645293:0:14668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b4b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381285632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789123330.645331:0:14668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123330.645388:0:14668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f340622f300 going to sleep for 11 seconds 00000100:00100000:3.0:1789123330.645415:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381285632 00000100:00100000:3.0:1789123330.645420:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381285632 00000100:00100000:3.0:1789123330.645479:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789123330.645487:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3436f5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+19:14668:x1876031381285632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789123330.645966:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3436f5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+19:14668:x1876031381285632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 479us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123330.645974:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789123330.646199:0:14668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b4b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39ef4522-e133-4b32-b80c-ca92d5b19344:14668:1876031381285632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789123330.646898:0:16871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789123330.646948:0:14668:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789123330.646964:0:14668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789123330.646973:0:14668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9f342d80a400/0x7e1648d68fc92f7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92f86 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123330.646983:0:14668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9f342d80a400/0x7e1648d68fc92f7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7e1648d68fc92f86 expref: -99 pid: 14668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123330.973439:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123330.974457:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364514432 00000100:00100000:3.0:1789123330.974469:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364514432 00000100:00100000:3.0:1789123330.974562:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 115 00000100:00100000:3.0:1789123330.974573:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3436f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e75c46a1-b06d-458e-9df3-84f8d5648d06+11:13956:x1876031364514432:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789123330.974619:0:14666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123330.974663:0:14666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f3402fba800/0x7e1648d68fc92f8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f9e1 expref: -99 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123330.974695:0:14666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f3402fba800/0x7e1648d68fc92f8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9e1 expref: 12 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123330.974707:0:14666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f3402fba800/0x7e1648d68fc92f8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9e1 expref: 12 pid: 14666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123330.974717:0:14666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fba800, rc 0) 00000100:00100000:3.0:1789123330.974778:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3436f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e75c46a1-b06d-458e-9df3-84f8d5648d06+12:13956:x1876031364514432:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 Request processed in 206us (1351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123330.974786:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 115 00000100:00100000:2.0:1789123330.978997:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123330.979100:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364514560 00000100:00100000:1.0:1789123330.979110:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364514560 00000100:00100000:1.0:1789123330.979174:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 116 00000100:00100000:1.0:1789123330.979185:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3436f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e75c46a1-b06d-458e-9df3-84f8d5648d06+12:13956:x1876031364514560:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789123330.979652:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3436f5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e75c46a1-b06d-458e-9df3-84f8d5648d06+12:13956:x1876031364514560:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 Request processed in 442us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123330.979661:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 116 00000100:00100000:0.0:1789123330.983452:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123330.983527:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364514688 00000100:00100000:3.0:1789123330.983537:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364514688 00000100:00100000:3.0:1789123330.983588:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 117 00000100:00100000:3.0:1789123330.983600:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3436f5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e75c46a1-b06d-458e-9df3-84f8d5648d06+12:13956:x1876031364514688:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789123330.984004:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3436f5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e75c46a1-b06d-458e-9df3-84f8d5648d06+12:13956:x1876031364514688:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 Request processed in 406us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123330.984013:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 117 00000100:00100000:3.0:1789123330.988749:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123330.989290:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364514816 00000100:00100000:2.0:1789123330.989301:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364514816 00000100:00100000:2.0:1789123330.989433:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 118 00000100:00100000:2.0:1789123330.989444:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3436f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e75c46a1-b06d-458e-9df3-84f8d5648d06+12:13956:x1876031364514816:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789123330.989462:0:14665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123330.989493:0:14665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f342d80ba00/0x7e1648d68fc92f94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f9e8 expref: -99 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123330.989522:0:14665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f342d80ba00/0x7e1648d68fc92f94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9e8 expref: 13 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123330.989535:0:14665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f342d80ba00/0x7e1648d68fc92f94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9e8 expref: 13 pid: 14665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123330.989544:0:14665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80ba00, rc 0) 00000100:00100000:2.0:1789123330.989758:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3436f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e75c46a1-b06d-458e-9df3-84f8d5648d06+13:13956:x1876031364514816:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 Request processed in 314us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123330.989766:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 118 00000100:00100000:2.0:1789123330.992989:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123330.993060:0:14666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364514944 00000100:00100000:3.0:1789123330.993069:0:14666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364514944 00000100:00100000:3.0:1789123330.993120:0:14666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 119 00000100:00100000:3.0:1789123330.993130:0:14666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3436f5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e75c46a1-b06d-458e-9df3-84f8d5648d06+13:13956:x1876031364514944:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789123330.993563:0:14666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3436f5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e75c46a1-b06d-458e-9df3-84f8d5648d06+13:13956:x1876031364514944:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 Request processed in 433us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123330.993573:0:14666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 119 00000100:00100000:2.0:1789123330.997746:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123330.997852:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364515072 00000100:00100000:3.0:1789123330.997869:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364515072 00000100:00100000:3.0:1789123330.997944:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 120 00000100:00100000:3.0:1789123330.997958:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3436f5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e75c46a1-b06d-458e-9df3-84f8d5648d06+13:13956:x1876031364515072:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789123330.998281:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3436f5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e75c46a1-b06d-458e-9df3-84f8d5648d06+13:13956:x1876031364515072:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 Request processed in 326us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123330.998290:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 120 00010000:00010000:0.0:1789123331.204937:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789123331.894261:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123331.894536:0:16551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364515200 00000100:00100000:1.0:1789123331.894549:0:16551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364515200 00000100:00100000:1.0:1789123331.895021:0:16551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 15 00000100:00100000:1.0:1789123331.895034:0:16551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+6:14612:x1876031364515200:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789123331.895064:0:16551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123331.895092:0:16551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514a00/0x7e1648d68fc92f9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f9ef expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.895177:0:16551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc92fa2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.895194:0:16551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc92fa2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.895209:0:16551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc92fa2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.895226:0:16551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515000/0x7e1648d68fc92fa9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.895233:0:16551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515000/0x7e1648d68fc92fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.895267:0:16551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515000/0x7e1648d68fc92fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.895916:0:16551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514000/0x7e1648d68fc92fb0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.895928:0:16551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514000/0x7e1648d68fc92fb0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.895937:0:16551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514000/0x7e1648d68fc92fb0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123331.896030:0:16551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1789123331.896035:0:16551:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1789123331.896133:0:16551:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514000/0x7e1648d68fc92fb0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.896146:0:16551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc92fa2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.896153:0:16551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc92fa2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.896161:0:16551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc92fa2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.896167:0:16551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401515a00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123331.896172:0:16551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc92fa2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.896181:0:16551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc92fa2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.896204:0:16551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f3409cd8e00) 00010000:00010000:1.0:1789123331.896207:0:16551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123331.896213:0:16551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc92fa2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.896220:0:16551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc92fa2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.896236:0:16551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515000/0x7e1648d68fc92fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.896242:0:16551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515000/0x7e1648d68fc92fa9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.896249:0:16551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515000/0x7e1648d68fc92fa9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.896254:0:16551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401515000 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123331.896257:0:16551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515000/0x7e1648d68fc92fa9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.896263:0:16551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515000/0x7e1648d68fc92fa9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.896271:0:16551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9f3409cd8100) 00010000:00010000:1.0:1789123331.896273:0:16551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123331.896276:0:16551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515000/0x7e1648d68fc92fa9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.896282:0:16551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515000/0x7e1648d68fc92fa9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.896339:0:16551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514a00/0x7e1648d68fc92f9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9ef expref: 8 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.896355:0:16551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514000/0x7e1648d68fc92fb0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9ef expref: 7 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.896363:0:16551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f3409cd8d00) 00010000:00010000:1.0:1789123331.896364:0:16551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789123331.896367:0:16551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3401514000, rc 0) 00000100:00100000:1.0:1789123331.896474:0:16551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+7:14612:x1876031364515200:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 1442us (2240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123331.896484:0:16551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 15 00000100:00080000:2.0:1789123331.899339:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789123331.902426:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123331.902754:0:14672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364515456 00000100:00100000:0.0:1789123331.902767:0:14672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364515456 00000100:00100000:0.0:1789123331.902885:0:14672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 16 00000100:00100000:0.0:1789123331.902898:0:14672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3970986-6c0c-4726-808e-9ec9e5a9682c+7:14612:x1876031364515456:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789123331.902947:0:14672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123331.902980:0:14672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52200/0x7e1648d68fc92fb7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f9f6 expref: -99 pid: 14672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.903097:0:14672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc92fbe lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.903117:0:14672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc92fbe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.903134:0:14672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc92fbe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.905534:0:14672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92fc5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.905559:0:14672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92fc5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.905573:0:14672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92fc5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.910269:0:14672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc92fcc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.910292:0:14672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc92fcc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.910304:0:14672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc92fcc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123331.910321:0:14672:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1789123331.911121:0:14672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc92fbe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.911133:0:14672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc92fbe lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.911140:0:14672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc92fbe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.911146:0:14672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53c00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123331.911150:0:14672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc92fbe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.911159:0:14672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc92fbe lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.911173:0:14672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f3409cd8d00) 00010000:00010000:0.0:1789123331.911176:0:14672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123331.911181:0:14672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc92fbe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.911187:0:14672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc92fbe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.911201:0:14672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92fc5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.911207:0:14672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92fc5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.911212:0:14672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92fc5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.911229:0:14672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52a00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123331.911232:0:14672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92fc5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.911238:0:14672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92fc5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.911246:0:14672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9f3402f40200) 00010000:00010000:0.0:1789123331.911248:0:14672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123331.911251:0:14672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92fc5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.911256:0:14672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92fc5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.912610:0:14672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52200/0x7e1648d68fc92fb7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9f6 expref: 10 pid: 14672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.912660:0:14672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52c00/0x7e1648d68fc92fcc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9f6 expref: 9 pid: 14672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.912669:0:14672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f3402f40c00) 00010000:00010000:0.0:1789123331.912685:0:14672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123331.912688:0:14672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b52c00, rc 0) 00000100:00100000:0.0:1789123331.912766:0:14672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3970986-6c0c-4726-808e-9ec9e5a9682c+9:14612:x1876031364515456:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 9870us (10355us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789123331.912775:0:14672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 16 00000100:00100000:2.0:1789123331.923495:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123331.924326:0:16551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364515584 00000100:00100000:1.0:1789123331.924342:0:16551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364515584 00000100:00100000:1.0:1789123331.924425:0:16551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 17 00000100:00100000:1.0:1789123331.924437:0:16551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+9:14612:x1876031364515584:12345-192.168.206.30@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789123331.924582:0:16551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+9:14612:x1876031364515584:12345-192.168.206.30@tcp:59:lhsmtool_posix.0 Request processed in 146us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123331.924594:0:16551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 17 00000100:00100000:1.0:1789123331.951923:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123331.952052:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364515712 00000100:00100000:2.0:1789123331.952065:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364515712 00000100:00100000:2.0:1789123331.952143:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 18 00000100:00100000:2.0:1789123331.952154:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+9:14618:x1876031364515712:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1789123331.952182:0:14670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123331.952215:0:14670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b000/0x7e1648d68fc92fda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7f9fd expref: -99 pid: 14670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123331.952311:0:14670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92fe1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123331.952353:0:14670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92fe1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123331.952368:0:14670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92fe1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123331.952385:0:14670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92fe8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123331.952392:0:14670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123331.952399:0:14670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123331.957286:0:14670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92fe1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123331.957311:0:14670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92fe1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123331.957321:0:14670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92fe1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123331.957330:0:14670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a200 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123331.957335:0:14670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92fe1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123331.957345:0:14670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92fe1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123331.957371:0:14670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f3409cd8e00) 00010000:00010000:2.0:1789123331.957384:0:14670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123331.957392:0:14670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92fe1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123331.957400:0:14670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc92fe1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123331.957420:0:14670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123331.957428:0:14670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92fe8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123331.957434:0:14670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92fe8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123331.957440:0:14670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80bc00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123331.957443:0:14670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92fe8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123331.957450:0:14670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92fe8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123331.957458:0:14670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f34232f7d00) 00010000:00010000:2.0:1789123331.957461:0:14670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123331.957465:0:14670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92fe8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123331.957471:0:14670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc92fe8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123331.957538:0:14670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b000/0x7e1648d68fc92fda lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9fd expref: 10 pid: 14670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123331.957557:0:14670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f3409cd8e00) 00010000:00010000:2.0:1789123331.957559:0:14670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123331.957564:0:14670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b000/0x7e1648d68fc92fda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9fd expref: 10 pid: 14670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123331.957575:0:14670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80b000, rc 0) 00000100:00100000:2.0:1789123331.957740:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+9:14618:x1876031364515712:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 5585us (5844us total) trans 0 rc 301/301 00000100:00100000:2.0:1789123331.957751:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 18 00000100:00100000:2.0:1789123331.964613:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123331.964997:0:14679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364515840 00000100:00100000:0.0:1789123331.965029:0:14679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364515840 00000100:00100000:0.0:1789123331.965193:0:14679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 0 00000100:00100000:0.0:1789123331.965204:0:14679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d3970986-6c0c-4726-808e-9ec9e5a9682c+9:14618:x1876031364515840:12345-192.168.206.30@tcp:700:lfs.0 00000100:00100000:0.0:1789123331.965383:0:14679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d3970986-6c0c-4726-808e-9ec9e5a9682c+9:14618:x1876031364515840:12345-192.168.206.30@tcp:700:lfs.0 Request processed in 181us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123331.965391:0:14679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 0 00000100:00100000:0.0:1789123331.972205:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123331.972537:0:14671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364516096 00000100:00100000:1.0:1789123331.972551:0:14671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364516096 00000100:00100000:1.0:1789123331.973526:0:14671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 19 00000100:00100000:1.0:1789123331.973543:0:14671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+9:14618:x1876031364516096:12345-192.168.206.30@tcp:36:lfs.0 00010000:00010000:1.0:1789123331.973889:0:14671:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123331.973938:0:14671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc92f1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f978 expref: 9 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.973962:0:14671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f3409cd8e00) 00010000:00010000:1.0:1789123331.973967:0:14671:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789123331.974933:0:14671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc92fef lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.974959:0:14671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc92f55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9da expref: 5 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.974970:0:14671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc92fef lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.975763:0:14671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc92f55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9da expref: 5 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123331.975787:0:14671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc92f55 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9da expref: 5 pid: 14671 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123331.975806:0:14671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d74fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14671:1876031381285760:192.168.206.30@tcp:104: 00000100:00100000:1.0:1789123331.975939:0:14671:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3402b96d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789123331.979257:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123331.979349:0:14656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364516224 00000100:00100000:3.0:1789123331.979362:0:14656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364516224 00010000:00010000:3.0:1789123331.979446:0:14656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc92f55 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9da expref: 6 pid: 14671 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123331.979507:0:14656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00100000:3.0:1789123331.979519:0:14656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afe1caaf-a00a-4897-8c78-69bf8bb551ac+6:2354:x1876031364516224:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789123331.979538:0:14656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123331.979547:0:14656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc92f55 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9da expref: 6 pid: 14671 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123331.979562:0:14656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc92f55 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9da expref: 6 pid: 14671 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123331.979592:0:14656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f3409cd8e00) 00010000:00010000:3.0:1789123331.979771:0:14656:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc92fef lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123331.979801:0:14656:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc92fef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123331.979809:0:14656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc92fef lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123331.979832:0:14656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789123331.979909:0:14656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afe1caaf-a00a-4897-8c78-69bf8bb551ac+6:2354:x1876031364516224:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 392us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123331.979918:0:14656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 9 00010000:00010000:0.0:1789123331.981411:0:14671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc92f55 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7f9da expref: 5 pid: 14671 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123331.981441:0:14671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d74fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14671:1876031381285760:192.168.206.30@tcp:104: 00010000:00010000:0.0:1789123331.981475:0:14671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc92fef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.981487:0:14671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc92fef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.981493:0:14671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc92fef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.981528:0:14671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92ff6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.981541:0:14671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92ff6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.981552:0:14671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92ff6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789123331.981801:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1789123331.988925:0:14671:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1789123331.988968:0:14671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc92fef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.988981:0:14671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc92fef lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.988989:0:14671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc92fef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.988997:0:14671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401515a00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123331.989002:0:14671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc92fef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.989011:0:14671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc92fef lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.989032:0:14671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f3409cd8e00) 00010000:00010000:0.0:1789123331.989036:0:14671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123331.989042:0:14671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc92fef lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123331.989049:0:14671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc92fef lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789123331.989078:0:14671:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e68ac6d2 reply state 0000000092df374b transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92ff6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123331.989088:0:14671:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789123331.989242:0:14671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+10:14618:x1876031364516096:12345-192.168.206.30@tcp:36:lfs.0 Request processed in 15700us (17046us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789123331.989253:0:14671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 19 00010000:00010000:2.0:1789123331.994129:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92ff6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123331.994154:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92ff6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123331.994163:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92ff6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123331.994170:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52a00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123331.994175:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92ff6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123331.994185:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92ff6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123331.994207:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f3402f40200) 00010000:00010000:2.0:1789123331.994229:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123331.994237:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92ff6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123331.994244:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52a00/0x7e1648d68fc92ff6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123332.070332:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123332.071082:0:14672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364516352 00000100:00100000:0.0:1789123332.071114:0:14672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364516352 00000100:00100000:0.0:1789123332.071257:0:14672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 20 00000100:00100000:0.0:1789123332.071270:0:14672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3970986-6c0c-4726-808e-9ec9e5a9682c+9:14626:x1876031364516352:12345-192.168.206.30@tcp:101:lctl.0 00010000:00010000:0.0:1789123332.071302:0:14672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123332.071334:0:14672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc92ffd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7fa04 expref: -99 pid: 14672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.071568:0:14672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc93004 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.071587:0:14672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc93004 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.071720:0:14672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc93004 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123332.072094:0:14672:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789123332.072099:0:14672:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1789123332.072159:0:14672:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc93004 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.072193:0:14672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc92ffd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa04 expref: 11 pid: 14672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.072216:0:14672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53600/0x7e1648d68fc93004 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa04 expref: 10 pid: 14672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.072226:0:14672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f3402f40900) 00010000:00010000:0.0:1789123332.072229:0:14672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789123332.072233:0:14672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53600, rc 0) 00000100:00100000:0.0:1789123332.072484:0:14672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3970986-6c0c-4726-808e-9ec9e5a9682c+10:14626:x1876031364516352:12345-192.168.206.30@tcp:101:lctl.0 Request processed in 1215us (2164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123332.072506:0:14672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 20 00000100:00100000:1.0:1789123332.108233:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123332.108517:0:16551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364516480 00000100:00100000:2.0:1789123332.108531:0:16551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364516480 00000100:00100000:2.0:1789123332.108621:0:16551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 21 00000100:00100000:2.0:1789123332.108672:0:16551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:afe1caaf-a00a-4897-8c78-69bf8bb551ac+5:14627:x1876031364516480:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1789123332.108700:0:16551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123332.108727:0:16551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc9300b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7fa0b expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.108810:0:16551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b800/0x7e1648d68fc93012 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.108828:0:16551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b800/0x7e1648d68fc93012 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.108842:0:16551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b800/0x7e1648d68fc93012 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123332.108934:0:16551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789123332.108939:0:16551:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1789123332.108969:0:16551:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b800/0x7e1648d68fc93012 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.109001:0:16551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc9300b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa0b expref: 7 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.109048:0:16551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b800/0x7e1648d68fc93012 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa0b expref: 6 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.109059:0:16551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f3402f40900) 00010000:00010000:2.0:1789123332.109432:0:16551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789123332.109438:0:16551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80b800, rc 0) 00000100:00100000:2.0:1789123332.109549:0:16551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:afe1caaf-a00a-4897-8c78-69bf8bb551ac+6:14627:x1876031364516480:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 880us (1329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123332.109559:0:16551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 21 00000100:00100000:3.0:1789123332.112892:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123332.113091:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364516608 00000100:00100000:2.0:1789123332.113104:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364516608 00000100:00100000:2.0:1789123332.113177:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 22 00000100:00100000:2.0:1789123332.113189:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:afe1caaf-a00a-4897-8c78-69bf8bb551ac+6:14627:x1876031364516608:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1789123332.113215:0:14670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123332.113239:0:14670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc93019 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7fa12 expref: -99 pid: 14670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.113509:0:14670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc93020 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.113528:0:14670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc93020 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.113541:0:14670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc93020 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.113560:0:14670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc93027 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.113586:0:14670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc93027 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.113594:0:14670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc93027 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.116894:0:14670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b000/0x7e1648d68fc9302e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.116922:0:14670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b000/0x7e1648d68fc9302e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.116938:0:14670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b000/0x7e1648d68fc9302e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123332.117021:0:14670:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1789123332.117026:0:14670:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789123332.117057:0:14670:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b000/0x7e1648d68fc9302e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.117073:0:14670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc93020 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.117081:0:14670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc93020 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.117087:0:14670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc93020 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.117093:0:14670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123332.117098:0:14670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc93020 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.117304:0:14670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc93020 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.117320:0:14670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f3402f40900) 00010000:00010000:2.0:1789123332.117323:0:14670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123332.117328:0:14670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc93020 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.117334:0:14670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc93020 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.117350:0:14670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc93027 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.117356:0:14670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc93027 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.117673:0:14670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc93027 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.117679:0:14670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80bc00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123332.117683:0:14670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc93027 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.117690:0:14670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc93027 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.117699:0:14670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f34232f7d00) 00010000:00010000:2.0:1789123332.117701:0:14670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123332.117704:0:14670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc93027 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.117721:0:14670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc93027 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.117764:0:14670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc93019 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa12 expref: 8 pid: 14670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.117778:0:14670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b000/0x7e1648d68fc9302e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa12 expref: 7 pid: 14670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.117785:0:14670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f34232f7400) 00010000:00010000:2.0:1789123332.117788:0:14670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789123332.117790:0:14670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80b000, rc 0) 00000100:00100000:2.0:1789123332.117929:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:afe1caaf-a00a-4897-8c78-69bf8bb551ac+7:14627:x1876031364516608:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 4741us (5050us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123332.117939:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 22 00000100:00100000:1.0:1789123332.125068:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123332.125151:0:16551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364516864 00000100:00100000:2.0:1789123332.125160:0:16551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364516864 00000100:00100000:2.0:1789123332.125219:0:16551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 23 00000100:00100000:2.0:1789123332.125230:0:16551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:afe1caaf-a00a-4897-8c78-69bf8bb551ac+7:14627:x1876031364516864:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1789123332.125255:0:16551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123332.125275:0:16551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc93035 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7fa19 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123332.125393:0:16551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1789123332.125500:0:16551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc93035 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa19 expref: 9 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.125530:0:16551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f3402f40900) 00010000:00010000:2.0:1789123332.125533:0:16551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789123332.125538:0:16551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc93035 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa19 expref: 9 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.125550:0:16551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80a200, rc 0) 00000100:00100000:2.0:1789123332.125744:0:16551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:afe1caaf-a00a-4897-8c78-69bf8bb551ac+8:14627:x1876031364516864:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 399us (580us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1789123332.125753:0:16551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 23 00000100:00100000:1.0:1789123332.133380:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123332.134476:0:14672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364517120 00000100:00100000:0.0:1789123332.134711:0:14672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364517120 00000100:00100000:0.0:1789123332.134833:0:14672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 24 00000100:00100000:0.0:1789123332.134844:0:14672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:afe1caaf-a00a-4897-8c78-69bf8bb551ac+8:14627:x1876031364517120:12345-192.168.206.30@tcp:36:lfs.0 00010000:00010000:0.0:1789123332.134899:0:14672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123332.134926:0:14672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b000/0x7e1648d68fc9302e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa12 expref: 8 pid: 14670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.134944:0:14672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f34232f7400) 00010000:00010000:0.0:1789123332.134955:0:14672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789123332.134978:0:14672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc93043 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.134989:0:14672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc93043 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.134998:0:14672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc93043 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789123332.135230:0:14672:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c781cefb reply state 00000000b7eaeda2 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc93043 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123332.135254:0:14672:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789123332.135268:0:14672:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1789123332.135358:0:14672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:afe1caaf-a00a-4897-8c78-69bf8bb551ac+9:14627:x1876031364517120:12345-192.168.206.30@tcp:36:lfs.0 Request processed in 515us (1988us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789123332.135365:0:14672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 24 00010000:00010000:2.0:1789123332.139285:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc93043 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.139302:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc93043 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.139310:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc93043 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.139317:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53c00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123332.139321:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc93043 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.139329:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc93043 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.139345:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f3402f40800) 00010000:00010000:2.0:1789123332.139348:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789123332.139353:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc93043 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.139367:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53c00/0x7e1648d68fc93043 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123332.142613:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123332.145346:0:14673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364517376 00000100:00100000:2.0:1789123332.145361:0:14673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364517376 00000100:00100000:2.0:1789123332.145427:0:14673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 2 00000100:00100000:2.0:1789123332.145438:0:14673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:afe1caaf-a00a-4897-8c78-69bf8bb551ac+8:14627:x1876031364517376:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:2.0:1789123332.148112:0:14673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:afe1caaf-a00a-4897-8c78-69bf8bb551ac+9:14627:x1876031364517376:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 2661us (5499us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789123332.148129:0:14673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 2 00000100:00100000:3.0:1789123332.151475:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123332.151536:0:16551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364517632 00000100:00100000:2.0:1789123332.151548:0:16551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364517632 00000100:00100000:2.0:1789123332.151655:0:16551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 25 00000100:00100000:2.0:1789123332.151668:0:16551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:afe1caaf-a00a-4897-8c78-69bf8bb551ac+9:14627:x1876031364517632:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1789123332.151695:0:16551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123332.151719:0:16551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc9304a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7fa20 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.151795:0:16551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc93051 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.151809:0:16551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc93051 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.151820:0:16551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc93051 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.151834:0:16551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc93058 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.151857:0:16551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc93058 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.151864:0:16551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc93058 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123332.152010:0:16551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1789123332.152118:0:16551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc93051 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.152126:0:16551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc93051 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.152133:0:16551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc93051 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.152139:0:16551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a800 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123332.152340:0:16551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc93051 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.152351:0:16551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc93051 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.152436:0:16551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f3402f40900) 00010000:00010000:2.0:1789123332.152441:0:16551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123332.152447:0:16551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc93051 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.152453:0:16551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc93051 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.152480:0:16551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc93058 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.152496:0:16551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc93058 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.152502:0:16551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc93058 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.152507:0:16551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80bc00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123332.152510:0:16551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc93058 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.152516:0:16551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc93058 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.152524:0:16551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f34232f7d00) 00010000:00010000:2.0:1789123332.152527:0:16551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123332.152530:0:16551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc93058 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.152535:0:16551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc93058 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.152680:0:16551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc9304a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa20 expref: 11 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.152692:0:16551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f3402f40900) 00010000:00010000:2.0:1789123332.152695:0:16551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789123332.152705:0:16551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc9304a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa20 expref: 11 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.152717:0:16551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80a200, rc 0) 00000100:00100000:2.0:1789123332.152836:0:16551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:afe1caaf-a00a-4897-8c78-69bf8bb551ac+10:14627:x1876031364517632:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 1171us (1373us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789123332.152845:0:16551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 25 00000100:00100000:1.0:1789123332.155816:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123332.156057:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364517760 00000100:00100000:2.0:1789123332.156068:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364517760 00000100:00100000:2.0:1789123332.156173:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 26 00000100:00100000:2.0:1789123332.156184:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:afe1caaf-a00a-4897-8c78-69bf8bb551ac+10:14627:x1876031364517760:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1789123332.156220:0:14670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123332.156245:0:14670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc93066 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7fa27 expref: -99 pid: 14670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.156337:0:14670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b000/0x7e1648d68fc9306d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.156351:0:14670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b000/0x7e1648d68fc9306d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.156363:0:14670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b000/0x7e1648d68fc9306d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123332.156425:0:14670:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1789123332.156429:0:14670:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789123332.156452:0:14670:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b000/0x7e1648d68fc9306d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.156498:0:14670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc93066 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa27 expref: 12 pid: 14670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.156521:0:14670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b000/0x7e1648d68fc9306d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa27 expref: 11 pid: 14670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.156530:0:14670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f34232f7900) 00010000:00010000:2.0:1789123332.156533:0:14670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789123332.156537:0:14670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80b000, rc 0) 00000100:00100000:2.0:1789123332.156612:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:afe1caaf-a00a-4897-8c78-69bf8bb551ac+11:14627:x1876031364517760:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 430us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123332.156619:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 26 00000100:00100000:3.0:1789123332.160739:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123332.160848:0:14674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364517888 00000100:00100000:0.0:1789123332.160859:0:14674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364517888 00000100:00100000:0.0:1789123332.160913:0:14674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 3 00000100:00100000:0.0:1789123332.160923:0:14674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:afe1caaf-a00a-4897-8c78-69bf8bb551ac+11:14627:x1876031364517888:12345-192.168.206.30@tcp:37:lfs.0 00000100:00100000:0.0:1789123332.168024:0:14674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:afe1caaf-a00a-4897-8c78-69bf8bb551ac+11:14627:x1876031364517888:12345-192.168.206.30@tcp:37:lfs.0 Request processed in 7093us (7289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123332.168036:0:14674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 3 00000100:00100000:3.0:1789123332.178317:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123332.179266:0:14673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364518144 00000100:00100000:2.0:1789123332.179278:0:14673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364518144 00000100:00100000:2.0:1789123332.179345:0:14673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 4 00000100:00100000:2.0:1789123332.179355:0:14673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3436e8dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:afe1caaf-a00a-4897-8c78-69bf8bb551ac+11:14627:x1876031364518144:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:2.0:1789123332.179900:0:14673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3436e8dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:afe1caaf-a00a-4897-8c78-69bf8bb551ac+12:14627:x1876031364518144:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 544us (1593us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789123332.179917:0:14673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 4 00000100:00100000:3.0:1789123332.221313:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123332.222749:0:14671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364518272 00000100:00100000:1.0:1789123332.222762:0:14671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364518272 00000100:00100000:1.0:1789123332.222884:0:14671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 27 00000100:00100000:1.0:1789123332.222895:0:14671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+10:14633:x1876031364518272:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:1.0:1789123332.222928:0:14671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123332.222950:0:14671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514a00/0x7e1648d68fc93074 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7fa2e expref: -99 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.223026:0:14671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc9307b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.223041:0:14671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc9307b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.223052:0:14671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc9307b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.223077:0:14671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc93082 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.223085:0:14671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc93082 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.223092:0:14671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc93082 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.223274:0:14671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515000/0x7e1648d68fc93089 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.223284:0:14671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515000/0x7e1648d68fc93089 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.223311:0:14671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515000/0x7e1648d68fc93089 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123332.223347:0:14671:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1789123332.223351:0:14671:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789123332.223397:0:14671:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515000/0x7e1648d68fc93089 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.223410:0:14671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc9307b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.223428:0:14671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc9307b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.223434:0:14671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc9307b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.223439:0:14671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401514e00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123332.223443:0:14671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc9307b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.223449:0:14671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc9307b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.223462:0:14671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f3402f40900) 00010000:00010000:1.0:1789123332.223466:0:14671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123332.223470:0:14671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc9307b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.223477:0:14671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc9307b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.224727:0:14671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc93082 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.224736:0:14671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc93082 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.224744:0:14671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc93082 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.224749:0:14671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401515600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123332.224753:0:14671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc93082 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.224761:0:14671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc93082 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.224773:0:14671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f3409cd8100) 00010000:00010000:1.0:1789123332.224777:0:14671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123332.224781:0:14671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc93082 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.224787:0:14671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc93082 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.224832:0:14671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514a00/0x7e1648d68fc93074 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa2e expref: 12 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.224847:0:14671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515000/0x7e1648d68fc93089 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa2e expref: 11 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.224873:0:14671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f34232f7900) 00010000:00010000:1.0:1789123332.224876:0:14671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789123332.224878:0:14671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3401515000, rc 0) 00000100:00100000:1.0:1789123332.224960:0:14671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+11:14633:x1876031364518272:12345-192.168.206.30@tcp:101:bash.0 Request processed in 2067us (3656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123332.224969:0:14671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 27 00010000:00010000:2.0:1789123332.228863:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123332.234281:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123332.237533:0:14672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364518528 00000100:00100000:0.0:1789123332.237546:0:14672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364518528 00000100:00100000:0.0:1789123332.237691:0:14672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 28 00000100:00100000:0.0:1789123332.237712:0:14672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3970986-6c0c-4726-808e-9ec9e5a9682c+11:14633:x1876031364518528:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:0.0:1789123332.237732:0:14672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123332.237752:0:14672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52e00/0x7e1648d68fc93090 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7fa35 expref: -99 pid: 14672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.238128:0:14672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc93097 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.238148:0:14672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b000/0x7e1648d68fc9306d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa27 expref: 11 pid: 14670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.238158:0:14672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc93097 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.238226:0:14672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b000/0x7e1648d68fc9306d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa27 expref: 11 pid: 14670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.238243:0:14672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b000/0x7e1648d68fc9306d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa27 expref: 11 pid: 14670 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123332.238279:0:14672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b4b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14672:1876031381285888:192.168.206.30@tcp:104: 00000100:00100000:0.0:1789123332.238394:0:14672:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f343c34f300 going to sleep for 11 seconds 00000100:00100000:0.0:1789123332.243479:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123332.243810:0:14672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b4b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14672:1876031381285888:192.168.206.30@tcp:104: 00010000:00010000:2.0:1789123332.243837:0:14672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc93097 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123332.245273:0:14658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364518656 00000100:00100000:1.0:1789123332.245285:0:14658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364518656 00010000:00010000:1.0:1789123332.245340:0:14658:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b000/0x7e1648d68fc9306d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa27 expref: 12 pid: 14670 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123332.245444:0:14658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 10 00000100:00100000:1.0:1789123332.245455:0:14658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b4a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:afe1caaf-a00a-4897-8c78-69bf8bb551ac+12:2354:x1876031364518656:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789123332.245470:0:14658:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123332.245478:0:14658:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b000/0x7e1648d68fc9306d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa27 expref: 12 pid: 14670 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.245490:0:14658:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b000/0x7e1648d68fc9306d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa27 expref: 12 pid: 14670 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.245511:0:14658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80b000/0x7e1648d68fc9306d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa27 expref: 12 pid: 14670 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.245525:0:14658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f34232f7900) 00010000:00010000:1.0:1789123332.245531:0:14658:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc93097 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.245555:0:14658:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc93097 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.245563:0:14658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc93097 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.245616:0:14658:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789123332.245725:0:14658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b4a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:afe1caaf-a00a-4897-8c78-69bf8bb551ac+11:2354:x1876031364518656:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 271us (2255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123332.245733:0:14658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 10 00010000:00010000:0.0:1789123332.245909:0:14672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc93097 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.245917:0:14672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc93097 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.245989:0:14672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc9309e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.246000:0:14672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc9309e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.246007:0:14672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc9309e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.246801:0:14672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc930a5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.246814:0:14672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc930a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.246821:0:14672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc930a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123332.246832:0:14672:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789123332.246858:0:14672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc93097 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.246875:0:14672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc93097 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.246882:0:14672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc93097 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.246888:0:14672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52800 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123332.246892:0:14672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc93097 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.246899:0:14672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc93097 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.246910:0:14672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f34232f7900) 00010000:00010000:0.0:1789123332.246913:0:14672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123332.246917:0:14672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc93097 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.246922:0:14672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc93097 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789123332.246936:0:14672:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000041ee03a9 reply state 00000000d8da0d3e transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc9309e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123332.246945:0:14672:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789123332.246980:0:14672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52e00/0x7e1648d68fc93090 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa35 expref: 14 pid: 14672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.246994:0:14672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc930a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa35 expref: 13 pid: 14672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.247012:0:14672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f3402f40500) 00010000:00010000:0.0:1789123332.247014:0:14672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789123332.247017:0:14672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53a00, rc 0) 00000100:00100000:0.0:1789123332.247066:0:14672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3970986-6c0c-4726-808e-9ec9e5a9682c+14:14633:x1876031364518528:12345-192.168.206.30@tcp:101:bash.0 Request processed in 9356us (12793us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789123332.247076:0:14672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 28 00010000:00010000:2.0:1789123332.249783:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc9309e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.249808:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc9309e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.249842:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc9309e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.249849:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123332.249854:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc9309e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.249862:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc9309e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.249880:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9f3402f40600) 00010000:00010000:2.0:1789123332.249883:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123332.249888:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc9309e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.249894:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52400/0x7e1648d68fc9309e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123332.267432:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123332.269774:0:16551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364518784 00000100:00100000:2.0:1789123332.269789:0:16551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364518784 00000100:00100000:3.0:1789123332.273466:0:16551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 29 00000100:00100000:3.0:1789123332.273481:0:16551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+13:14633:x1876031364518784:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:3.0:1789123332.273507:0:16551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789123332.273531:0:16551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc930b3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7fa3c expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123332.273615:0:16551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc930ba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123332.273652:0:16551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc930ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123332.273690:0:16551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc930ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789123332.273733:0:16551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789123332.273738:0:16551:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789123332.273766:0:16551:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc930ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123332.273778:0:16551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc930ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123332.273948:0:16551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc930b3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa3c expref: 15 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123332.273969:0:16551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc930ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa3c expref: 14 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123332.273976:0:16551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f3402f40500) 00010000:00010000:3.0:1789123332.273979:0:16551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789123332.273983:0:16551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3402fbae00, rc 0) 00000100:00100000:3.0:1789123332.274066:0:16551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+14:14633:x1876031364518784:12345-192.168.206.30@tcp:101:bash.0 Request processed in 588us (6642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123332.274073:0:16551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 29 00000100:00100000:3.0:1789123332.277803:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123332.278552:0:14674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364519040 00000100:00100000:0.0:1789123332.278564:0:14674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364519040 00000100:00100000:0.0:1789123332.278735:0:14674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 5 00000100:00100000:0.0:1789123332.278747:0:14674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+14:14633:x1876031364519040:12345-192.168.206.30@tcp:35:bash.0 00000001:00080000:0.0:1789123332.279102:0:14674:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934601 00000100:00100000:0.0:1789123332.279255:0:14674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+16:14633:x1876031364519040:12345-192.168.206.30@tcp:35:bash.0 Request processed in 509us (1458us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1789123332.279265:0:14674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 5 00000020:00080000:0.0:1789123332.279271:0:14674:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789123332.374937:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123332.375163:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364519296 00000100:00100000:2.0:1789123332.375172:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364519296 00000100:00100000:2.0:1789123332.375232:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 30 00000100:00100000:2.0:1789123332.375242:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+16:14643:x1876031364519296:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1789123332.375264:0:14670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123332.375286:0:14670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc930c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7fa43 expref: -99 pid: 14670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789123332.375395:0:14670:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1789123332.375532:0:14670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc930c1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa43 expref: 18 pid: 14670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.375547:0:14670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f3402f40900) 00010000:00010000:2.0:1789123332.375551:0:14670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789123332.375557:0:14670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a600/0x7e1648d68fc930c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa43 expref: 18 pid: 14670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.375571:0:14670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80a600, rc 0) 00000100:00100000:2.0:1789123332.376372:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+17:14643:x1876031364519296:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 1126us (1440us total) trans 8589934603 rc 301/301 00000100:00100000:2.0:1789123332.376381:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 30 00000100:00100000:3.0:1789123332.387429:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123332.387530:0:14673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364519552 00000100:00100000:2.0:1789123332.387545:0:14673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364519552 00000100:00100000:2.0:1789123332.387670:0:14673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 6 00000100:00100000:2.0:1789123332.387682:0:14673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+17:14643:x1876031364519552:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:2.0:1789123332.387961:0:14673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+18:14643:x1876031364519552:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 280us (545us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789123332.387969:0:14673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 6 00000100:00100000:3.0:1789123332.424376:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123332.424577:0:14671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364519808 00000100:00100000:1.0:1789123332.424590:0:14671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364519808 00000100:00100000:1.0:1789123332.424769:0:14671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 31 00000100:00100000:1.0:1789123332.424782:0:14671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+18:14646:x1876031364519808:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1789123332.424815:0:14671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123332.424842:0:14671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514a00/0x7e1648d68fc930cf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7fa4a expref: -99 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.425090:0:14671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc930d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.425109:0:14671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc930d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.425123:0:14671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc930d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123332.425137:0:14671:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789123332.425301:0:14671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514a00/0x7e1648d68fc930cf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa4a expref: 21 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.425343:0:14671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc930d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa4a expref: 20 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.425353:0:14671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f3402f40500) 00010000:00010000:1.0:1789123332.425356:0:14671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789123332.425360:0:14671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3401515600, rc 0) 00000100:00100000:1.0:1789123332.425502:0:14671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+20:14646:x1876031364519808:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 713us (1132us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1789123332.425512:0:14671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 31 00000100:00100000:3.0:1789123332.433224:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123332.433270:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123332.433934:0:16791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364520064 00000100:00100000:1.0:1789123332.433947:0:16791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364520064 00000100:00100000:1.0:1789123332.434023:0:16791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 0 00000100:00100000:1.0:1789123332.434034:0:16791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355fed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+20:2355:x1876031364520064:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789123332.434057:0:16791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123332.434086:0:16791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc930d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa4a expref: 20 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.434112:0:16791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f3402f40500) 00010000:00010000:1.0:1789123332.434118:0:16791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789123332.434187:0:16791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355fed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+19:2355:x1876031364520064:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 156us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123332.434196:0:16791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 0 00000100:00100000:0.0:1789123332.434365:0:14672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364519936 00000100:00100000:0.0:1789123332.434371:0:14672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364519936 00000100:00100000:0.0:1789123332.434414:0:14672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 32 00000100:00100000:0.0:1789123332.434422:0:14672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3970986-6c0c-4726-808e-9ec9e5a9682c+19:14646:x1876031364519936:12345-192.168.206.30@tcp:54:lfs.0 00010000:00010000:0.0:1789123332.434496:0:14672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc930e4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.434512:0:14672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc930e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.434536:0:14672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc930e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.434579:0:14672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc930e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.434587:0:14672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc930e4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.434885:0:14672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc930e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.434894:0:14672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52800 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123332.434899:0:14672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc930e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.434908:0:14672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc930e4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.434918:0:14672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f3402f40500) 00010000:00010000:0.0:1789123332.434921:0:14672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789123332.434925:0:14672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc930e4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.434931:0:14672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52800/0x7e1648d68fc930e4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123332.435106:0:14672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3970986-6c0c-4726-808e-9ec9e5a9682c+19:14646:x1876031364519936:12345-192.168.206.30@tcp:54:lfs.0 Request processed in 683us (1895us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123332.435115:0:14672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 32 00000100:00100000:0.0:1789123332.439128:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123332.443206:0:14673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364520320 00000100:00100000:2.0:1789123332.443227:0:14673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364520320 00000100:00100000:2.0:1789123332.443314:0:14673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:2.0:1789123332.443327:0:14673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+19:14646:x1876031364520320:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:2.0:1789123332.443961:0:14673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+20:14646:x1876031364520320:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 632us (4841us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789123332.443974:0:14673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:1.0:1789123332.613913:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39ef4522-e133-4b32-b80c-ca92d5b19344:3303:1876031381286016:0@lo:400:kworker.0 00000100:00100000:1.0:1789123332.613998:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123332.614113:0:14663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381286016 00000100:00100000:1.0:1789123332.614123:0:14663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381286016 00000100:00100000:3.0:1789123332.614149:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381286144:0@lo:400:kworker.0 00000100:00100000:2.0:1789123332.614149:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f343585f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381286272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789123332.614177:0:14663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789123332.614192:0:14663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3436f5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+19:3303:x1876031381286016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123332.614317:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381286400:0@lo:400:kworker.0 00000100:00100000:2.0:1789123332.615974:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123332.616253:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123332.616319:0:14663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3436f5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39ef4522-e133-4b32-b80c-ca92d5b19344+19:3303:x1876031381286016:12345-0@lo:400:kworker.0 Request processed in 2124us (2313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123332.616344:0:14663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789123332.616344:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789123332.616405:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789123332.616420:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b4b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381286528:0@lo:400:kworker.0 00000100:00100000:1.0:1789123332.616423:0:15356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381286144 00000100:00100000:1.0:1789123332.616435:0:15356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381286144 00000100:00100000:0.0:1789123332.616502:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789123332.616522:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381286656:0@lo:400:kworker.0 00000100:00100000:3.0:1789123332.616553:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123332.616583:0:15356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381286400 00000100:00100000:3.0:1789123332.616585:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789123332.616591:0:15356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381286400 00000100:00100000:3.0:1789123332.616707:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34062db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876031381286784:0@lo:400:kworker.0 00000100:00100000:3.0:1789123332.616738:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123332.617410:0:15356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789123332.617423:0:15356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381286144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123332.617526:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789123332.617574:0:15356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876031381286144:12345-0@lo:400:kworker.0 Request processed in 151us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123332.617584:0:15356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789123332.617887:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39ef4522-e133-4b32-b80c-ca92d5b19344:3303:1876031381286016:0@lo:400:kworker.0 00000100:00100000:0.0:1789123332.617939:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381286528 00000100:00100000:0.0:1789123332.617945:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381286528 00000100:00100000:0.0:1789123332.617989:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381286656 00000100:00100000:0.0:1789123332.617993:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381286656 00000100:00100000:0.0:1789123332.618017:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381286784 00000100:00100000:0.0:1789123332.618020:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381286784 00000100:00100000:3.0:1789123332.618035:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381286400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789123332.618043:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789123332.618052:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381286528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789123332.618111:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381286400:12345-0@lo:400:kworker.0 Request processed in 577us (1779us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123332.618121:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789123332.618713:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876031381286144:0@lo:400:kworker.0 00000100:00100000:1.0:1789123332.618763:0:16551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789123332.618777:0:16551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381286656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123332.618857:0:16551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876031381286656:12345-0@lo:400:kworker.0 Request processed in 86us (2303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123332.618865:0:16551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789123332.618898:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876031381286656:0@lo:400:kworker.0 00000100:00100000:1.0:1789123332.618919:0:16551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789123332.618926:0:16551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876031381286784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789123332.618963:0:16551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876031381286784:12345-0@lo:400:kworker.0 Request processed in 38us (2224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123332.618986:0:16551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789123332.619017:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34062db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876031381286784:0@lo:400:kworker.0 00000100:00100000:1.0:1789123332.619079:0:15358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381286272 00000100:00100000:1.0:1789123332.619086:0:15358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381286272 00000100:00100000:1.0:1789123332.619126:0:15358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789123332.619133:0:15358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381286272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789123332.619163:0:15358:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789123332.619197:0:15358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876031381286272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (3231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123332.619203:0:15358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1789123332.619246:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789123332.619253:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789123332.619256:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789123332.619316:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f343585f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876031381286272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789123332.620119:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876031381286528:12345-0@lo:400:kworker.0 Request processed in 2064us (3613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123332.620131:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789123332.621180:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b4b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876031381286528:0@lo:400:kworker.0 00000100:00100000:3.0:1789123332.621199:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381286400:0@lo:400:kworker.0 00000040:00080000:0.0:1789123332.677387:0:14707:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789123332.738809:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123332.738951:0:16551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364520576 00000100:00100000:1.0:1789123332.738964:0:16551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364520576 00000100:00100000:1.0:1789123332.739056:0:16551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 33 00000100:00100000:1.0:1789123332.739070:0:16551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+20:14677:x1876031364520576:12345-192.168.206.30@tcp:101:cat.0 00010000:00010000:1.0:1789123332.739111:0:16551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123332.739141:0:16551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc930eb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7fa51 expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.739347:0:16551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514a00/0x7e1648d68fc930f2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.739366:0:16551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514a00/0x7e1648d68fc930f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.739385:0:16551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514a00/0x7e1648d68fc930f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123332.739420:0:16551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789123332.740057:0:16551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc930eb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa51 expref: 23 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.740083:0:16551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514a00/0x7e1648d68fc930f2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa51 expref: 22 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.740093:0:16551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f3402f40500) 00010000:00010000:1.0:1789123332.740096:0:16551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789123332.740100:0:16551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3401514a00, rc 0) 00000100:00100000:1.0:1789123332.740231:0:16551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+22:14677:x1876031364520576:12345-192.168.206.30@tcp:101:cat.0 Request processed in 1164us (1437us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1789123332.740240:0:16551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 33 00000100:00100000:3.0:1789123332.745466:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123332.745983:0:14657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364520704 00000100:00100000:2.0:1789123332.745998:0:14657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364520704 00000100:00100000:2.0:1789123332.746089:0:14657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 1 00000100:00100000:2.0:1789123332.746101:0:14657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355fde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+22:2355:x1876031364520704:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789123332.746121:0:14657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123332.746155:0:14657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514a00/0x7e1648d68fc930f2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa51 expref: 22 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.746179:0:14657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f3402f40500) 00010000:00010000:2.0:1789123332.746186:0:14657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123332.746257:0:14657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355fde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+21:2355:x1876031364520704:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 158us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123332.746275:0:14657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 1 00000100:00100000:0.0:1789123332.749817:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123332.750074:0:14674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364520960 00000100:00100000:3.0:1789123332.750088:0:14674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364520960 00000100:00100000:3.0:1789123332.750191:0:14674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 8 00000100:00100000:3.0:1789123332.750205:0:14674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+21:14677:x1876031364520960:12345-192.168.206.30@tcp:35:cat.0 00000100:00100000:3.0:1789123332.750694:0:14674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+22:14677:x1876031364520960:12345-192.168.206.30@tcp:35:cat.0 Request processed in 491us (891us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1789123332.750704:0:14674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 8 00000100:00100000:0.0:1789123332.828246:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123332.828443:0:14672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364521216 00000100:00100000:1.0:1789123332.828456:0:14672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364521216 00000100:00100000:1.0:1789123332.828704:0:14672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 34 00000100:00100000:1.0:1789123332.828718:0:14672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3970986-6c0c-4726-808e-9ec9e5a9682c+22:14683:x1876031364521216:12345-192.168.206.30@tcp:101:dd.0 00010000:00010000:1.0:1789123332.828750:0:14672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123332.828777:0:14672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc93100 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7fa58 expref: -99 pid: 14672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.828908:0:14672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc93107 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.828926:0:14672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc930a5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa35 expref: 23 pid: 14672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.828959:0:14672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc930ba lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa3c expref: 23 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.828968:0:14672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc93107 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.829009:0:14672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc930ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa3c expref: 23 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.829025:0:14672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc930ba lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa3c expref: 23 pid: 16551 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123332.829041:0:14672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d74c780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14672:1876031381286912:192.168.206.30@tcp:104: 00010000:00010000:1.0:1789123332.829316:0:14672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc930a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa35 expref: 23 pid: 14672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.829327:0:14672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc930a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa35 expref: 23 pid: 14672 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123332.829337:0:14672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d74ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14672:1876031381287040:192.168.206.30@tcp:104: 00000100:00100000:1.0:1789123332.829362:0:14672:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410be0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789123332.833749:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123332.833850:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123332.833962:0:14672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d74c780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14672:1876031381286912:192.168.206.30@tcp:104: 00000100:00100000:1.0:1789123332.833979:0:14672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d74ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14672:1876031381287040:192.168.206.30@tcp:104: 00010000:00010000:1.0:1789123332.834015:0:14672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc93107 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123332.838277:0:16791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364521344 00000100:00100000:3.0:1789123332.838296:0:16791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364521344 00010000:00010000:3.0:1789123332.838362:0:16791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc930ba lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa3c expref: 24 pid: 16551 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123332.840286:0:16791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364521472 00000100:00100000:3.0:1789123332.840307:0:16791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364521472 00010000:00010000:3.0:1789123332.840366:0:16791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc930a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa35 expref: 25 pid: 14672 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123332.840434:0:14656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 11 00000100:00100000:0.0:1789123332.840442:0:14657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 12 00000100:00100000:2.0:1789123332.840450:0:14656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3301309450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+25:2354:x1876031364521344:12345-192.168.206.30@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789123332.840452:0:14657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+25:2354:x1876031364521472:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789123332.840468:0:14656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123332.840468:0:14657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789123332.840477:0:14656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc930ba lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa3c expref: 25 pid: 16551 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.840488:0:14657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc930a5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa35 expref: 25 pid: 14672 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.840563:0:14656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc930ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa3c expref: 25 pid: 16551 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.840575:0:14657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc930a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa35 expref: 25 pid: 14672 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.841066:0:14656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbae00/0x7e1648d68fc930ba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa3c expref: 25 pid: 16551 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.841101:0:14656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f3402f40500) 00010000:00010000:2.0:1789123332.841107:0:14656:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc93107 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.841117:0:14656:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc93107 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.841124:0:14656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123332.841258:0:14656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3301309450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+24:2354:x1876031364521344:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 812us (7635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123332.841268:0:14656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 11 00010000:00010000:0.0:1789123332.843010:0:14657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc930a5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa35 expref: 23 pid: 14672 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.843039:0:14657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f3402f40500) 00010000:00010000:0.0:1789123332.843046:0:14657:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc93107 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.843057:0:14657:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc93107 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.843065:0:14657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc93107 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.843242:0:14657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789123332.843324:0:14657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+22:2354:x1876031364521472:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 2871us (9471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123332.843335:0:14657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 12 00010000:00010000:0.0:1789123332.845558:0:14672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc93107 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.845580:0:14672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc93107 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123332.846033:0:14672:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789123332.846387:0:14672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc93100 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa58 expref: 23 pid: 14672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.846413:0:14672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514e00/0x7e1648d68fc93107 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa58 expref: 22 pid: 14672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.846423:0:14672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f3402f40500) 00010000:00010000:1.0:1789123332.846426:0:14672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789123332.846430:0:14672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3401514e00, rc 0) 00000100:00100000:1.0:1789123332.846659:0:14672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3970986-6c0c-4726-808e-9ec9e5a9682c+22:14683:x1876031364521216:12345-192.168.206.30@tcp:101:dd.0 Request processed in 17942us (18424us total) trans 8589934609 rc 0/0 00000100:00100000:1.0:1789123332.846670:0:14672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 34 00000100:00100000:1.0:1789123332.849568:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123332.849827:0:14671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364521728 00000100:00100000:2.0:1789123332.849839:0:14671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364521728 00000100:00100000:2.0:1789123332.849990:0:14671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 35 00000100:00100000:2.0:1789123332.850004:0:14671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+22:14683:x1876031364521728:12345-192.168.206.30@tcp:36:dd.0 00010000:00010000:2.0:1789123332.850339:0:14671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc93115 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.850360:0:14671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc93115 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.850372:0:14671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc93115 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789123332.850425:0:14671:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934610 00000004:00010000:2.0:1789123332.850457:0:14671:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ecd9c5f9 reply state 00000000a450220d transno 8589934611 ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc93115 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123332.850560:0:14671:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789123332.850842:0:14671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+25:14683:x1876031364521728:12345-192.168.206.30@tcp:36:dd.0 Request processed in 839us (1284us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1789123332.850849:0:14671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 35 00000020:00080000:2.0:1789123332.850856:0:14671:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789123332.852555:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc93115 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.852573:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc93115 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.852580:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc93115 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.852587:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a200 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123332.852601:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc93115 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.852610:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc93115 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.852848:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f3402f40500) 00010000:00010000:2.0:1789123332.852853:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789123332.852859:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc93115 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.852866:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc93115 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123332.858169:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123332.858430:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364521856 00000100:00100000:0.0:1789123332.858443:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364521856 00000100:00100000:0.0:1789123332.858526:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 36 00000100:00100000:0.0:1789123332.858539:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+24:14683:x1876031364521856:12345-192.168.206.30@tcp:101:dd.0 00010000:00010000:0.0:1789123332.858571:0:14670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123332.858670:0:14670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc9311c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7fa5f expref: -99 pid: 14670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.859084:0:14670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc9311c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa5f expref: 25 pid: 14670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.859110:0:14670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc9311c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa5f expref: 25 pid: 14670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123332.859133:0:14670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f3402f40500) 00010000:00010000:2.0:1789123332.859137:0:14670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789123332.859142:0:14670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53a00, rc 0) 00000100:00100000:2.0:1789123332.859225:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+25:14683:x1876031364521856:12345-192.168.206.30@tcp:101:dd.0 Request processed in 688us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123332.859234:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 36 00000100:00100000:3.0:1789123332.869183:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123332.870676:0:16791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364522112 00000100:00100000:1.0:1789123332.870695:0:16791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364522112 00000100:00100000:1.0:1789123332.870909:0:16791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 2 00000100:00100000:1.0:1789123332.870924:0:16791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+25:14683:x1876031364522112:12345-192.168.206.30@tcp:103:dd.0 00010000:00010000:1.0:1789123332.871123:0:16791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123332.871233:0:16791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc9311c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa5f expref: 25 pid: 14670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123332.871301:0:16791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f3402f40500) 00010000:00010000:1.0:1789123332.871307:0:16791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789123332.871416:0:16791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+24:14683:x1876031364522112:12345-192.168.206.30@tcp:103:dd.0 Request processed in 495us (2249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123332.871426:0:16791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 2 00000100:00100000:1.0:1789123332.874257:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123332.874363:0:16551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364522240 00000100:00100000:3.0:1789123332.874385:0:16551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364522240 00000100:00100000:3.0:1789123332.874458:0:16551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 37 00000100:00100000:3.0:1789123332.874470:0:16551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+24:14683:x1876031364522240:12345-192.168.206.30@tcp:58:dd.0 00010000:00010000:3.0:1789123332.875401:0:16551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc93123 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123332.875427:0:16551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc93123 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123332.875440:0:16551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc93123 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789123332.881026:0:16551:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789123332.881946:0:16551:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789123332.882043:0:16551:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789123332.882281:0:16551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+24:14683:x1876031364522240:12345-192.168.206.30@tcp:58:dd.0 Request processed in 7806us (8032us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123332.882295:0:16551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 37 00000100:00100000:3.0:1789123332.888242:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123332.888963:0:14672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364522368 00000100:00100000:0.0:1789123332.888980:0:14672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364522368 00000100:00100000:0.0:1789123332.889062:0:14672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 38 00000100:00100000:0.0:1789123332.889074:0:14672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3970986-6c0c-4726-808e-9ec9e5a9682c+24:14683:x1876031364522368:12345-192.168.206.30@tcp:101:dd.0 00010000:00010000:0.0:1789123332.889100:0:14672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123332.889127:0:14672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52200/0x7e1648d68fc9312a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7fa66 expref: -99 pid: 14672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.889205:0:14672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc93123 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.889218:0:14672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52200/0x7e1648d68fc9312a lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa66 expref: 25 pid: 14672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.889243:0:14672:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc93123 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.889257:0:14672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52200/0x7e1648d68fc9312a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa66 expref: 25 pid: 14672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.889272:0:14672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f3402f40500) 00010000:00010000:0.0:1789123332.889275:0:14672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789123332.889279:0:14672:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52200/0x7e1648d68fc9312a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa66 expref: 25 pid: 14672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123332.889287:0:14672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b52200, rc 0) 00000100:00100000:0.0:1789123332.889390:0:14672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3970986-6c0c-4726-808e-9ec9e5a9682c+25:14683:x1876031364522368:12345-192.168.206.30@tcp:101:dd.0 Request processed in 317us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123332.889398:0:14672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 38 00010000:00010000:0.0:1789123333.253870:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789123333.532559:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123333.532715:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123333.532819:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123333.532836:0:14671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364522624 00000100:00100000:1.0:1789123333.532859:0:14671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364522624 00000100:00100000:2.0:1789123333.532943:0:14665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364522496 00000100:00100000:2.0:1789123333.532954:0:14665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364522496 00000100:00100000:1.0:1789123333.532988:0:14671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 24 00000100:00100000:1.0:1789123333.533006:0:14671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+25:2352:x1876031364522624:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1789123333.533018:0:14665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 122 00000100:00100000:2.0:1789123333.533033:0:14665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3436f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e75c46a1-b06d-458e-9df3-84f8d5648d06+13:2352:x1876031364522496:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1789123333.533127:0:14671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+25:2352:x1876031364522624:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 126us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123333.533137:0:14671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 24 00000100:00080000:1.0:1789123333.533170:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789123333.534423:0:15356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364522880 00000100:00100000:0.0:1789123333.534434:0:15356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364522880 00000100:00100000:0.0:1789123333.534508:0:15356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 12 00000100:00100000:0.0:1789123333.534520:0:15356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+5:2353:x1876031364522880:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1789123333.535507:0:14665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3436f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e75c46a1-b06d-458e-9df3-84f8d5648d06+13:2352:x1876031364522496:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 2471us (2950us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123333.535518:0:14665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 122 00000100:00080000:2.0:1789123333.535608:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789123333.535815:0:15356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+5:2353:x1876031364522880:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 1296us (2999us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123333.535824:0:15356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 12 00000100:00100000:3.0:1789123333.536039:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123333.536162:0:15357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364523136 00000100:00100000:0.0:1789123333.536169:0:15357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364523136 00000100:00100000:0.0:1789123333.536313:0:15357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 13 00000100:00100000:0.0:1789123333.536322:0:15357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34355fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:afe1caaf-a00a-4897-8c78-69bf8bb551ac+5:2353:x1876031364523136:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123333.536368:0:15357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34355fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:afe1caaf-a00a-4897-8c78-69bf8bb551ac+5:2353:x1876031364523136:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 47us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123333.536374:0:15357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 13 00000100:00080000:2.0:1789123333.536417:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789123333.536484:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123333.536542:0:15956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364522752 00000100:00100000:2.0:1789123333.536547:0:15956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364522752 00000100:00100000:2.0:1789123333.536684:0:15956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 14 00000100:00100000:2.0:1789123333.536692:0:15956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+5:2353:x1876031364522752:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1789123333.536821:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123333.536846:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123333.536864:0:15357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364523264 00000100:00100000:3.0:1789123333.536891:0:15357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364523264 00000100:00100000:0.0:1789123333.536933:0:14672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364523008 00000100:00100000:0.0:1789123333.536937:0:14672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364523008 00000100:00080000:1.0:1789123333.537171:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789123333.537175:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789123333.537177:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789123333.537735:0:15956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+5:2353:x1876031364522752:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 876us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123333.537747:0:15956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 14 00000100:00100000:0.0:1789123333.538928:0:14672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 25 00000100:00100000:0.0:1789123333.538941:0:14672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:afe1caaf-a00a-4897-8c78-69bf8bb551ac+11:2353:x1876031364523008:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1789123333.539017:0:14672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:afe1caaf-a00a-4897-8c78-69bf8bb551ac+11:2353:x1876031364523008:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 78us (2195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123333.539025:0:14672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 25 00000100:00100000:3.0:1789123333.540681:0:15357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 15 00000100:00100000:3.0:1789123333.540695:0:15357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:afe1caaf-a00a-4897-8c78-69bf8bb551ac+5:2353:x1876031364523264:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1789123333.540750:0:15357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:afe1caaf-a00a-4897-8c78-69bf8bb551ac+5:2353:x1876031364523264:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 58us (3902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123333.540758:0:15357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 15 00000040:00080000:0.0:1789123333.700857:0:14707:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789123333.700878:0:14707:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789123333.700922:0:14707:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789123333.700929:0:14707:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789123333.701053:0:14707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3410b483c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14707:1876031381287168:192.168.206.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789123333.701172:0:14707:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410bcd180 going to sleep for 11 seconds 00000100:00100000:0.0:1789123333.705209:0:14707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3410b483c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14707:1876031381287168:192.168.206.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789123333.705213:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123333.705315:0:14681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364523392 00000100:00100000:3.0:1789123333.705334:0:14681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364523392 00000100:00100000:3.0:1789123333.705374:0:14681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 0 00000100:00100000:0.0:1789123333.705383:0:14682:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 2 min 2 max 256 00000100:00100000:3.0:1789123333.705384:0:14681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d3970986-6c0c-4726-808e-9ec9e5a9682c+25:14684:x1876031364523392:12345-192.168.206.30@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789123333.705390:0:14682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0002' 00000100:00100000:3.0:1789123333.705467:0:14681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d3970986-6c0c-4726-808e-9ec9e5a9682c+25:14684:x1876031364523392:12345-192.168.206.30@tcp:900:lhsmtool_posix.0 Request processed in 84us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123333.705475:0:14681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 0 00000100:00100000:2.0:1789123333.708267:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123333.708365:0:14671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364523520 00000100:00100000:1.0:1789123333.708374:0:14671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364523520 00000100:00100000:1.0:1789123333.708431:0:14671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 39 00000100:00100000:1.0:1789123333.708442:0:14671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+25:14684:x1876031364523520:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789123333.708472:0:14671:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789123333.708597:0:14671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+25:14684:x1876031364523520:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 Request processed in 145us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123333.708622:0:14671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 39 00000100:00100000:0.0:1789123333.713778:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123333.713870:0:14672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364523648 00000100:00100000:1.0:1789123333.713884:0:14672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364523648 00000100:00100000:1.0:1789123333.713944:0:14672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 40 00000100:00100000:1.0:1789123333.713955:0:14672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3970986-6c0c-4726-808e-9ec9e5a9682c+25:14684:x1876031364523648:12345-192.168.206.30@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789123333.714023:0:14672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc93131 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.714039:0:14672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc93131 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.714052:0:14672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc93131 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.714128:0:14672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93138 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.714137:0:14672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93138 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.714145:0:14672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93138 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.714167:0:14672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc9313f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.714175:0:14672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc9313f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.714182:0:14672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc9313f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123333.714231:0:14672:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789123333.714236:0:14672:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789123333.714248:0:14672:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc9313f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.714259:0:14672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc93131 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.714266:0:14672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc93131 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.714273:0:14672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc93131 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.714278:0:14672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401515a00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123333.714282:0:14672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc93131 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.714386:0:14672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc93131 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.714402:0:14672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f3402f40c00) 00010000:00010000:1.0:1789123333.714405:0:14672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123333.714410:0:14672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc93131 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.714417:0:14672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc93131 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.714434:0:14672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93138 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.714452:0:14672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93138 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.714773:0:14672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93138 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.714781:0:14672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401514c00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123333.714784:0:14672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93138 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.714792:0:14672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93138 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.714978:0:14672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9f3409cd8100) 00010000:00010000:1.0:1789123333.714981:0:14672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123333.714985:0:14672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93138 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.714991:0:14672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93138 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.715009:0:14672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc9313f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.715015:0:14672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc9313f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.715124:0:14672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc9313f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.715130:0:14672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401515e00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123333.715150:0:14672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc9313f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.715157:0:14672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc9313f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.715165:0:14672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f3402f40500) 00010000:00010000:1.0:1789123333.715167:0:14672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123333.715171:0:14672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc9313f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.715176:0:14672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc9313f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123333.715264:0:14672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3970986-6c0c-4726-808e-9ec9e5a9682c+25:14684:x1876031364523648:12345-192.168.206.30@tcp:34:lhsmtool_posix.0 Request processed in 1310us (1492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123333.715273:0:14672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 40 00000100:00100000:3.0:1789123333.722712:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123333.722786:0:14671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364523904 00000100:00100000:1.0:1789123333.722795:0:14671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364523904 00000100:00100000:1.0:1789123333.722853:0:14671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 41 00000100:00100000:1.0:1789123333.722863:0:14671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+25:14684:x1876031364523904:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789123333.722884:0:14671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123333.722904:0:14671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc93146 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7fa6d expref: -99 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.722994:0:14671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc9314d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.723009:0:14671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc9314d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.723038:0:14671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc9314d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789123333.723050:0:14671:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789123333.723149:0:14671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc9314d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.723156:0:14671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc9314d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.723162:0:14671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc9314d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.723168:0:14671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401514c00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123333.723172:0:14671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc9314d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.723179:0:14671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc9314d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.723191:0:14671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f3402f40500) 00010000:00010000:1.0:1789123333.723194:0:14671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789123333.723199:0:14671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc9314d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.723205:0:14671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc9314d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.723254:0:14671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc93146 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa6d expref: 27 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.723277:0:14671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f3402f40c00) 00010000:00010000:1.0:1789123333.723279:0:14671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789123333.723284:0:14671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc93146 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa6d expref: 27 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.723294:0:14671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3401515e00, rc 0) 00000100:00100000:1.0:1789123333.723355:0:14671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+26:14684:x1876031364523904:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 493us (662us total) trans 8589934612 rc 301/301 00000100:00100000:1.0:1789123333.723362:0:14671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 41 00000100:00100000:0.0:1789123333.725928:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123333.726016:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364524032 00000100:00100000:2.0:1789123333.726027:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364524032 00000100:00100000:2.0:1789123333.726090:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 42 00000100:00100000:2.0:1789123333.726100:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+26:14684:x1876031364524032:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789123333.726134:0:14670:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789123333.726251:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+26:14684:x1876031364524032:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 Request processed in 151us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123333.726259:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 42 00000100:00100000:0.0:1789123333.729548:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123333.729605:0:14671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364524288 00000100:00100000:1.0:1789123333.729615:0:14671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364524288 00000100:00100000:1.0:1789123333.729687:0:14671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 43 00000100:00100000:1.0:1789123333.729697:0:14671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+26:14684:x1876031364524288:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789123333.729715:0:14671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123333.729736:0:14671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc9315b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7fa74 expref: -99 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789123333.730375:0:14671:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:1.0:1789123333.730383:0:14671:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:1.0:1789123333.730440:0:14671:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1789123333.730751:0:14671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc93162 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.730766:0:14671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc93162 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.730776:0:14671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc93162 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.730845:0:14671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc9315b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa74 expref: 29 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.730864:0:14671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc93162 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa74 expref: 28 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.730873:0:14671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f3409cd8100) 00010000:00010000:1.0:1789123333.730881:0:14671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789123333.730885:0:14671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3401515600, rc 0) 00000100:00100000:1.0:1789123333.730953:0:14671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+28:14684:x1876031364524288:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 1257us (1413us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1789123333.730961:0:14671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 43 00000100:00100000:3.0:1789123333.733739:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123333.734036:0:14672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364524544 00000100:00100000:1.0:1789123333.734046:0:14672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364524544 00000100:00100000:1.0:1789123333.734116:0:14672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 44 00000100:00100000:1.0:1789123333.734126:0:14672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3970986-6c0c-4726-808e-9ec9e5a9682c+28:14684:x1876031364524544:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789123333.734201:0:14672:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789123333.734226:0:14672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc93162 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa74 expref: 28 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.734244:0:14672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f3409cd8100) 00010000:00010000:1.0:1789123333.734254:0:14672:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789123333.734705:0:14672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc93170 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.734721:0:14672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc93170 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.734739:0:14672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc93170 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.736047:0:14672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93177 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x526d11ac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.736066:0:14672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93177 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x526d11ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.736077:0:14672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93177 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x526d11ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.736155:0:14672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc93170 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.736161:0:14672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc93170 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.736167:0:14672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc93170 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.736173:0:14672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401515e00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123333.736177:0:14672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc93170 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.736184:0:14672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc93170 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.736196:0:14672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f34232f7900) 00010000:00010000:1.0:1789123333.736199:0:14672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123333.736203:0:14672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc93170 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.736222:0:14672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515e00/0x7e1648d68fc93170 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.736237:0:14672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93177 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x526d11ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.736249:0:14672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93177 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x526d11ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.736256:0:14672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93177 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x526d11ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.736261:0:14672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401514c00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123333.736264:0:14672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93177 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x526d11ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.736271:0:14672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93177 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x526d11ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.736280:0:14672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x526d11ac (ffff9f3409cd8400) 00010000:00010000:1.0:1789123333.736283:0:14672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123333.736285:0:14672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93177 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x526d11ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.736292:0:14672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93177 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x526d11ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123333.736399:0:14672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3970986-6c0c-4726-808e-9ec9e5a9682c+27:14684:x1876031364524544:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 2271us (2665us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789123333.736408:0:14672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 44 00000100:00100000:0.0:1789123333.740176:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123333.740406:0:16551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364524672 00000100:00100000:2.0:1789123333.740416:0:16551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364524672 00000100:00100000:2.0:1789123333.741797:0:16551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 45 00000100:00100000:2.0:1789123333.741819:0:16551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+27:14684:x1876031364524672:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789123333.741840:0:16551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789123333.741868:0:16551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc9317e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7fa7b expref: -99 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123333.741915:0:16551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc93185 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123333.741933:0:16551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc93185 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123333.741963:0:16551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc93185 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123333.742086:0:16551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80bc00/0x7e1648d68fc9317e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa7b expref: 29 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123333.742107:0:16551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a800/0x7e1648d68fc93185 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa7b expref: 28 pid: 16551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123333.742115:0:16551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f34232f7d00) 00010000:00010000:2.0:1789123333.742119:0:16551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789123333.742122:0:16551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f342d80a800, rc 0) 00000100:00100000:2.0:1789123333.742181:0:16551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+28:14684:x1876031364524672:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 372us (2013us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123333.746016:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123333.746552:0:16551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 45 00000100:00100000:2.0:1789123333.746612:0:16551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364524928 00000100:00100000:2.0:1789123333.746620:0:16551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364524928 00000100:00100000:2.0:1789123333.746686:0:16551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 46 00000100:00100000:2.0:1789123333.746695:0:16551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3410b4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+28:14684:x1876031364524928:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789123333.746771:0:16551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc9318c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123333.746787:0:16551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc9318c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123333.746798:0:16551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc9318c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789123333.747219:0:16551:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1789123333.747230:0:16551:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 448077601429ns, next at 449077599364ns, rc = 0 00000004:00010000:2.0:1789123333.747315:0:16551:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002ab5356e reply state 000000008816bd86 transno 8589934614 ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc9318c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123333.747325:0:16551:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789123333.747425:0:16551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3410b4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+30:14684:x1876031364524928:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 728us (1415us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1789123333.747432:0:16551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 46 00000100:00100000:0.0:1789123333.750311:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123333.750620:0:14671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364525056 00000100:00100000:1.0:1789123333.750646:0:14671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364525056 00000100:00100000:1.0:1789123333.750704:0:14671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 47 00000100:00100000:1.0:1789123333.750714:0:14671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34048a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+30:14684:x1876031364525056:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789123333.750737:0:14671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123333.750760:0:14671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93193 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7fa82 expref: -99 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.750821:0:14671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93193 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa82 expref: 31 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.750836:0:14671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93193 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa82 expref: 31 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.750855:0:14671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f34232f7d00) 00010000:00010000:1.0:1789123333.750859:0:14671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789123333.750862:0:14671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3401514c00, rc 0) 00000100:00100000:1.0:1789123333.751020:0:14671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34048a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+31:14684:x1876031364525056:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 306us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123333.751028:0:14671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 47 00010000:00010000:2.0:1789123333.751360:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc9318c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123333.751369:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc9318c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123333.751376:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc9318c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123333.751382:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a200 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:2.0:1789123333.751387:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc9318c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123333.751395:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc9318c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123333.751408:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f34232f7d00) 00010000:00010000:2.0:1789123333.751411:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789123333.751415:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc9318c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123333.751438:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f342d80a200/0x7e1648d68fc9318c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123333.756231:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123333.756307:0:15356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364525184 00000100:00100000:1.0:1789123333.756317:0:15356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364525184 00000100:00100000:1.0:1789123333.756366:0:15356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 12 00000100:00100000:1.0:1789123333.756375:0:15356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+5:2355:x1876031364525184:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789123333.756942:0:15356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+6:2355:x1876031364525184:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 Request processed in 565us (718us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789123333.756952:0:15356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 12 00000100:00100000:3.0:1789123333.760230:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123333.760585:0:14673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364525440 00000100:00100000:2.0:1789123333.760606:0:14673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364525440 00000100:00100000:2.0:1789123333.760695:0:14673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00100000:2.0:1789123333.760706:0:14673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+30:14684:x1876031364525440:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789123333.760956:0:14673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+31:14684:x1876031364525440:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 Request processed in 248us (731us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1789123333.760964:0:14673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00100000:0.0:1789123333.767624:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123333.767801:0:16551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364525696 00000100:00100000:2.0:1789123333.767810:0:16551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364525696 00000100:00100000:2.0:1789123333.767872:0:16551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 48 00000100:00100000:2.0:1789123333.767883:0:16551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34048a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+31:14684:x1876031364525696:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789123333.767986:0:16551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34048a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+31:14684:x1876031364525696:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 104us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123333.767994:0:16551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 48 00000100:00100000:1.0:1789123333.772138:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123333.772238:0:14672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364525824 00000100:00100000:0.0:1789123333.772247:0:14672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364525824 00000100:00100000:0.0:1789123333.772307:0:14672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 49 00000100:00100000:0.0:1789123333.772319:0:14672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3970986-6c0c-4726-808e-9ec9e5a9682c+31:14684:x1876031364525824:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789123333.772339:0:14672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123333.772360:0:14672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc9319a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7fa89 expref: -99 pid: 14672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123333.772429:0:14672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53200/0x7e1648d68fc931a1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123333.772444:0:14672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53200/0x7e1648d68fc931a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123333.772475:0:14672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53200/0x7e1648d68fc931a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789123333.772511:0:14672:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789123333.772530:0:14672:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53200/0x7e1648d68fc931a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14672 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123333.772557:0:14672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53a00/0x7e1648d68fc9319a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa89 expref: 33 pid: 14672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123333.772576:0:14672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53200/0x7e1648d68fc931a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa89 expref: 32 pid: 14672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123333.772584:0:14672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f34232f7d00) 00010000:00010000:0.0:1789123333.772598:0:14672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789123333.772603:0:14672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53200, rc 0) 00000100:00100000:0.0:1789123333.772711:0:14672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3970986-6c0c-4726-808e-9ec9e5a9682c+32:14684:x1876031364525824:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 395us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123333.772719:0:14672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 49 00000100:00100000:0.0:1789123333.777046:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123333.777176:0:15355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364525952 00000100:00100000:1.0:1789123333.777190:0:15355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364525952 00000100:00100000:1.0:1789123333.777402:0:15355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 13 00000100:00100000:1.0:1789123333.777415:0:15355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34048a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+6:2355:x1876031364525952:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789123333.777440:0:15355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789123333.777531:0:15355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000280ddb25/0x7e1648d68fc931a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7fa90 expref: -99 pid: 15355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789123333.777567:0:15355:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3db05, blocks: 0x1 00010000:00010000:1.0:1789123333.777602:0:15355:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789123333.777608:0:15355:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123333.777620:0:15355:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000280ddb25/0x7e1648d68fc931a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa90 expref: 7 pid: 15355 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.777776:0:15355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000280ddb25/0x7e1648d68fc931a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa90 expref: 7 pid: 15355 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.777793:0:15355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3401515600, rc 0) 00000100:00100000:1.0:1789123333.777939:0:15355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34048a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+7:2355:x1876031364525952:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 526us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123333.777947:0:15355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 13 00000100:00100000:2.0:1789123333.781517:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123333.781598:0:16551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364526208 00000100:00100000:1.0:1789123333.781612:0:16551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364526208 00000100:00100000:1.0:1789123333.781803:0:16551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 50 00000100:00100000:1.0:1789123333.781820:0:16551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+32:14684:x1876031364526208:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789123333.782086:0:16551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+32:14684:x1876031364526208:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 267us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123333.782096:0:16551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 50 00000100:00100000:2.0:1789123333.786253:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123333.789159:0:14672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364526336 00000100:00100000:0.0:1789123333.789182:0:14672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364526336 00000100:00100000:0.0:1789123333.789274:0:14672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 51 00000100:00100000:0.0:1789123333.789287:0:14672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f343585e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3970986-6c0c-4726-808e-9ec9e5a9682c+32:14684:x1876031364526336:12345-192.168.206.30@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1789123333.823929:0:14672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f343585e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3970986-6c0c-4726-808e-9ec9e5a9682c+32:14684:x1876031364526336:12345-192.168.206.30@tcp:44:lhsmtool_posix.0 Request processed in 34634us (37673us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123333.823942:0:14672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 51 00000001:00080000:0.0:1789123333.824675:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934602 is committed 00000001:00080000:0.0:1789123333.824699:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:0.0:1789123333.824709:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000001:00080000:0.0:1789123333.824722:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934615 is committed 00000004:00080000:0.0:1789123333.824728:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1789123333.824757:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1789123333.825050:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381287296:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789123333.825103:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123333.825206:0:15356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381287296 00000100:00100000:1.0:1789123333.825214:0:15356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381287296 00000100:00100000:1.0:1789123333.825263:0:15356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789123333.825272:0:15356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34048a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381287296:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789123333.825414:0:15356:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789123333.825417:0:15356:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1789123333.825420:0:15356:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789123333.825422:0:15356:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789123333 -> 1789123333 00002000:00010000:1.0:1789123333.825424:0:15356:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789123333.825623:0:15356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34048a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1876031381287296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 351us (517us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789123333.825663:0:15356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1789123333.825819:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f3409cb5e00/2, rc 0, transno 8589934595 00000100:00100000:3.0:1789123333.825826:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381287296:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789123333.827840:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123333.827942:0:15357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364526464 00000100:00100000:3.0:1789123333.827950:0:15357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364526464 00000100:00100000:3.0:1789123333.828001:0:15357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 15 00000100:00100000:3.0:1789123333.828011:0:15357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34048a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d3970986-6c0c-4726-808e-9ec9e5a9682c+7:2354:x1876031364526464:12345-192.168.206.30@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789123333.828282:0:15357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34048a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d3970986-6c0c-4726-808e-9ec9e5a9682c+7:2354:x1876031364526464:12345-192.168.206.30@tcp:16:lhsmtool_posix.0 Request processed in 271us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123333.828304:0:15357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 15 00000100:00100000:3.0:1789123333.835175:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123333.835346:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364526720 00000100:00100000:0.0:1789123333.835359:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364526720 00000100:00100000:0.0:1789123333.835430:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 52 00000100:00100000:0.0:1789123333.835439:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+14:14684:x1876031364526720:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789123333.835483:0:14670:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789123333.835506:0:14670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53200/0x7e1648d68fc931a1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa89 expref: 14 pid: 14672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123333.835526:0:14670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f34232f7d00) 00010000:00010000:0.0:1789123333.835530:0:14670:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789123333.835557:0:14670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc931af lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123333.835570:0:14670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc931af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123333.835579:0:14670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc931af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789123333.835893:0:14670:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000730c5152 reply state 00000000a24e9a3b transno 8589934616 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc931af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123333.835915:0:14670:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789123333.836022:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+15:14684:x1876031364526720:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 583us (862us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1789123333.836029:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 52 00010000:00010000:0.0:1789123333.838343:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc931af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123333.838367:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc931af lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123333.838387:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc931af lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123333.838395:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b53400 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:0.0:1789123333.838401:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc931af lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123333.838410:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc931af lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123333.838433:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f34232f7d00) 00010000:00010000:0.0:1789123333.838436:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789123333.838442:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc931af lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123333.838449:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b53400/0x7e1648d68fc931af lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14670 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123333.840554:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123333.840863:0:15956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364526848 00000100:00100000:0.0:1789123333.840876:0:15956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364526848 00000100:00100000:0.0:1789123333.840951:0:15956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 16 00000100:00100000:0.0:1789123333.840963:0:15956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+7:14684:x1876031364526848:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789123333.840985:0:15956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789123333.841789:0:15956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a01961d7/0x7e1648d68fc931b6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x98b8beeb2bc7fa97 expref: -99 pid: 15956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123333.841834:0:15956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000280ddb25/0x7e1648d68fc931a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa90 expref: 8 pid: 15355 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123333.841845:0:15956:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123333.841850:0:15956:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123333.841856:0:15956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a01961d7/0x7e1648d68fc931b6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa97 expref: 8 pid: 15956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123333.841903:0:15956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000280ddb25/0x7e1648d68fc931a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa90 expref: 8 pid: 15355 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123333.841921:0:15956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000280ddb25/0x7e1648d68fc931a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa90 expref: 8 pid: 15355 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123333.841939:0:15956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34048a1680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15956:1876031381287424:192.168.206.30@tcp:104: 00000100:00100000:1.0:1789123333.842816:0:15956:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410bcde40 going to sleep for 11 seconds 00000100:00100000:2.0:1789123333.847624:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123333.848307:0:15956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34048a1680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15956:1876031381287424:192.168.206.30@tcp:104: 00010000:00010000:1.0:1789123333.848354:0:15956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a01961d7/0x7e1648d68fc931b6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa97 expref: 8 pid: 15956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.848382:0:15956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f3435b53200, rc 0) 00000100:00100000:1.0:1789123333.848538:0:15956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+8:14684:x1876031364526848:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 7575us (7997us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123333.848548:0:15956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 16 00000100:00100000:3.0:1789123333.849216:0:14656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364526976 00000100:00100000:3.0:1789123333.849230:0:14656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364526976 00010000:00010000:3.0:1789123333.849277:0:14656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000280ddb25/0x7e1648d68fc931a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa90 expref: 8 pid: 15355 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123333.849879:0:14656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 13 00000100:00100000:3.0:1789123333.849896:0:14656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+8:2354:x1876031364526976:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789123333.849916:0:14656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123333.849947:0:14656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000280ddb25/0x7e1648d68fc931a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa90 expref: 8 pid: 15355 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123333.849963:0:14656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000280ddb25/0x7e1648d68fc931a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa90 expref: 8 pid: 15355 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123333.849990:0:14656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000280ddb25/0x7e1648d68fc931a8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa90 expref: 8 pid: 15355 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123333.850008:0:14656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789123333.850012:0:14656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789123333.850019:0:14656:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a01961d7/0x7e1648d68fc931b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa97 expref: 7 pid: 15956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123333.850052:0:14656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a01961d7/0x7e1648d68fc931b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa97 expref: 7 pid: 15956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123333.850094:0:14656:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a01961d7/0x7e1648d68fc931b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa97 expref: 7 pid: 15956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123333.850110:0:14656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f3409cb4780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14656:1876031381287552:192.168.206.30@tcp:105: 00000100:00100000:3.0:1789123333.850192:0:14656:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f342d7340c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789123333.855166:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123333.855309:0:15357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364527104 00000100:00100000:0.0:1789123333.855320:0:15357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364527104 00000100:00100000:3.0:1789123333.855322:0:14656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f3409cb4780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14656:1876031381287552:192.168.206.30@tcp:105: 00010000:00010000:3.0:1789123333.855381:0:14656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789123333.855461:0:14656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+8:2354:x1876031364526976:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 5569us (7851us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123333.855462:0:15357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 17 00000100:00100000:0.0:1789123333.855478:0:15357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062ca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d3970986-6c0c-4726-808e-9ec9e5a9682c+8:2353:x1876031364527104:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789123333.855481:0:14656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 13 00002000:00010000:0.0:1789123333.855811:0:15357:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789123333.855815:0:15357:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789123332 00002000:00010000:0.0:1789123333.855818:0:15357:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789123331 00002000:00010000:0.0:1789123333.855820:0:15357:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789123333 -> 1789123332 00002000:00010000:0.0:1789123333.855823:0:15357:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789123333.855867:0:15357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062ca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d3970986-6c0c-4726-808e-9ec9e5a9682c+8:2353:x1876031364527104:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 Request processed in 393us (715us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789123333.855874:0:15357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 17 00000100:00100000:0.0:1789123333.860906:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123333.861233:0:15356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364527232 00000100:00100000:1.0:1789123333.861263:0:15356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364527232 00000100:00100000:1.0:1789123333.861403:0:15356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 18 00000100:00100000:1.0:1789123333.861416:0:15356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34048a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+8:2352:x1876031364527232:12345-192.168.206.30@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789123333.861491:0:15356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000af13bbaa/0x7e1648d68fc931bd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.861516:0:15356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a01961d7/0x7e1648d68fc931b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa97 expref: 8 pid: 15956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.861525:0:15356:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123333.861530:0:15356:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789123333.861535:0:15356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af13bbaa/0x7e1648d68fc931bd lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.861578:0:15356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a01961d7/0x7e1648d68fc931b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa97 expref: 8 pid: 15956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.861606:0:15356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a01961d7/0x7e1648d68fc931b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa97 expref: 8 pid: 15956 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123333.861624:0:15356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d74c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15356:1876031381287680:192.168.206.30@tcp:104: 00000100:00100000:1.0:1789123333.861774:0:15356:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410be0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789123333.865341:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123333.865438:0:14658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364527360 00000100:00100000:3.0:1789123333.865450:0:14658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364527360 00000100:00100000:1.0:1789123333.865485:0:15356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d74c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15356:1876031381287680:192.168.206.30@tcp:104: 00010000:00010000:3.0:1789123333.865497:0:14658:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a01961d7/0x7e1648d68fc931b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa97 expref: 9 pid: 15956 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.865514:0:15356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000af13bbaa/0x7e1648d68fc931bd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123333.865561:0:14658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 14 00000100:00100000:3.0:1789123333.865581:0:14658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3970986-6c0c-4726-808e-9ec9e5a9682c+9:2355:x1876031364527360:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789123333.865610:0:14658:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123333.865685:0:14658:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a01961d7/0x7e1648d68fc931b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa97 expref: 9 pid: 15956 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123333.865712:0:14658:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a01961d7/0x7e1648d68fc931b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa97 expref: 9 pid: 15956 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123333.865743:0:14658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a01961d7/0x7e1648d68fc931b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa97 expref: 9 pid: 15956 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123333.865761:0:14658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789123333.865766:0:14658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789123333.865772:0:14658:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af13bbaa/0x7e1648d68fc931bd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123333.865783:0:14658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af13bbaa/0x7e1648d68fc931bd lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123333.865862:0:14658:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789123333.865930:0:14658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3970986-6c0c-4726-808e-9ec9e5a9682c+8:2355:x1876031364527360:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 350us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123333.865950:0:14658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 14 00010000:00010000:1.0:1789123333.866584:0:15356:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000af13bbaa/0x7e1648d68fc931bd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.866607:0:15356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af13bbaa/0x7e1648d68fc931bd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.866660:0:15356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000af13bbaa/0x7e1648d68fc931bd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.866670:0:15356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af13bbaa/0x7e1648d68fc931bd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.866678:0:15356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af13bbaa/0x7e1648d68fc931bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.866685:0:15356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401514a00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123333.866689:0:15356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af13bbaa/0x7e1648d68fc931bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.866699:0:15356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af13bbaa/0x7e1648d68fc931bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.866714:0:15356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af13bbaa/0x7e1648d68fc931bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.866738:0:15356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af13bbaa/0x7e1648d68fc931bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123333.866866:0:15356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34048a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+7:2352:x1876031364527232:12345-192.168.206.30@tcp:1:lhsmtool_posix.0 Request processed in 5402us (5923us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123333.866878:0:15356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 18 00000100:00100000:2.0:1789123333.870161:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123333.870380:0:14671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364527616 00000100:00100000:1.0:1789123333.870393:0:14671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364527616 00000100:00100000:1.0:1789123333.870464:0:14671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 53 00000100:00100000:1.0:1789123333.870476:0:14671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+14:14684:x1876031364527616:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789123333.870582:0:14671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc931c4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.870616:0:14671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc931c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.870833:0:14671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc931c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.872063:0:14671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc931cb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.872090:0:14671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93193 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa82 expref: 15 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.872099:0:14671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc931cb lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.872159:0:14671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93193 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa82 expref: 15 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.872178:0:14671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93193 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa82 expref: 15 pid: 14671 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123333.872195:0:14671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d74c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14671:1876031381287808:192.168.206.30@tcp:104: 00000100:00100000:1.0:1789123333.872378:0:14671:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410be0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789123333.878286:0:14671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d74c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14671:1876031381287808:192.168.206.30@tcp:104: 00010000:00010000:1.0:1789123333.878328:0:14671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc931cb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789123333.879024:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123333.879131:0:14657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364527744 00000100:00100000:1.0:1789123333.879141:0:14657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364527744 00010000:00010000:1.0:1789123333.879187:0:14657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93193 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa82 expref: 16 pid: 14671 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123333.879568:0:14656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 15 00000100:00100000:3.0:1789123333.879584:0:14656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+16:2354:x1876031364527744:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789123333.879614:0:14656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789123333.879623:0:14656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93193 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa82 expref: 16 pid: 14671 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123333.879674:0:14656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93193 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa82 expref: 16 pid: 14671 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123333.879706:0:14656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514c00/0x7e1648d68fc93193 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa82 expref: 16 pid: 14671 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123333.879751:0:14656:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f34232f7d00) 00010000:00010000:3.0:1789123333.879758:0:14656:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc931cb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123333.879770:0:14656:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc931cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123333.879780:0:14656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc931cb lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123333.879816:0:14656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789123333.880211:0:14671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc931cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.880221:0:14671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc931cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123333.880299:0:14656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+15:2354:x1876031364527744:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 719us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789123333.880309:0:14656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 15 00000001:00080000:1.0:1789123333.880751:0:14671:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1789123333.881054:0:14671:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000001:00080000:1.0:1789123333.881107:0:14671:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1789123333.881481:0:14671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d74c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14671:1876031381287936:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789123333.886867:0:14671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123333.886937:0:14671:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410be0300 going to sleep for 11 seconds 00000100:00100000:0.0:1789123333.887015:0:14675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381287936 00000100:00100000:0.0:1789123333.887031:0:14675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381287936 00000100:00100000:0.0:1789123333.887107:0:14675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789123333.887119:0:14675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14671:x1876031381287936:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789123333.887346:0:14675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14671:x1876031381287936:12345-0@lo:1000:mdt00_001.0 Request processed in 225us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789123333.887356:0:14675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789123333.888717:0:14671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d74c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14671:1876031381287936:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1789123333.889413:0:14671:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934620 00000100:00100000:1.0:1789123333.889522:0:14671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f342d74c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14671:1876031381288064:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789123333.889598:0:14671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123333.889669:0:14671:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410be0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789123333.889929:0:14676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381288064 00000100:00100000:3.0:1789123333.889936:0:14676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381288064 00000100:00100000:3.0:1789123333.890097:0:14676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789123333.890108:0:14676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f342d74c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14671:x1876031381288064:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789123333.890281:0:14676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f342d74c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14671:x1876031381288064:12345-0@lo:1000:mdt00_001.0 Request processed in 176us (693us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789123333.890290:0:14676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789123333.890405:0:14671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f342d74c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14671:1876031381288064:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1789123333.890441:0:14671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc931cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.890450:0:14671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc931cb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.890457:0:14671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc931cb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.890463:0:14671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401515a00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123333.890568:0:14671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc931cb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.890580:0:14671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc931cb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.890606:0:14671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f34232f7d00) 00010000:00010000:1.0:1789123333.890610:0:14671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789123333.890618:0:14671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc931cb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.890623:0:14671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515a00/0x7e1648d68fc931cb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.890703:0:14671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc93123 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.890710:0:14671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc93123 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.890715:0:14671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc93123 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.890720:0:14671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fba600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123333.890722:0:14671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc93123 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.890728:0:14671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc93123 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.890736:0:14671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f3402f40500) 00010000:00010000:1.0:1789123333.890739:0:14671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789123333.890746:0:14671:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52200/0x7e1648d68fc9312a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa66 expref: 18 pid: 14672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.890757:0:14671:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52200/0x7e1648d68fc9312a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa66 expref: 18 pid: 14672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.890765:0:14671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52200/0x7e1648d68fc9312a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa66 expref: 18 pid: 14672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.890815:0:14671:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f3435b52200/0x7e1648d68fc9312a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x98b8beeb2bc7fa66 expref: 18 pid: 14672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123333.890839:0:14671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14671:1876031381288192:192.168.206.30@tcp:105: 00000100:00100000:1.0:1789123333.890913:0:14671:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f3410be0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789123333.896167:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123333.896375:0:14673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364527872 00000100:00100000:2.0:1789123333.896385:0:14673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364527872 00000100:00100000:2.0:1789123333.896462:0:14673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 10 00000100:00100000:2.0:1789123333.896475:0:14673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3436e8e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+19:14683:x1876031364527872:12345-192.168.206.30@tcp:49:dd.0 00000100:00100000:2.0:1789123333.896666:0:14673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3436e8e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+19:14683:x1876031364527872:12345-192.168.206.30@tcp:49:dd.0 Request processed in 194us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789123333.896675:0:14673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 10 00000100:00100000:1.0:1789123333.896961:0:14671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14671:1876031381288192:192.168.206.30@tcp:105: 00010000:00010000:1.0:1789123333.897060:0:14671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc93123 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.897071:0:14671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fba600/0x7e1648d68fc93123 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.897104:0:14671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514a00/0x7e1648d68fc931d2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.897127:0:14671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514a00/0x7e1648d68fc931d2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.897137:0:14671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514a00/0x7e1648d68fc931d2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.897146:0:14671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514a00/0x7e1648d68fc931d2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.897152:0:14671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514a00/0x7e1648d68fc931d2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.897157:0:14671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514a00/0x7e1648d68fc931d2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.897162:0:14671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401514a00 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123333.897166:0:14671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514a00/0x7e1648d68fc931d2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.897186:0:14671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514a00/0x7e1648d68fc931d2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.897197:0:14671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f3402f40500) 00010000:00010000:1.0:1789123333.897200:0:14671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789123333.897204:0:14671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514a00/0x7e1648d68fc931d2 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.897209:0:14671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401514a00/0x7e1648d68fc931d2 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.897221:0:14671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc931c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.897227:0:14671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc931c4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.897233:0:14671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc931c4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.897237:0:14671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401515600 already unused, calling callback (ffffffffc21e84f0) 00010000:00010000:1.0:1789123333.897240:0:14671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc931c4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.897246:0:14671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc931c4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.897254:0:14671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f3402f40500) 00010000:00010000:1.0:1789123333.897257:0:14671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789123333.897260:0:14671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc931c4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123333.897276:0:14671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3401515600/0x7e1648d68fc931c4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14671 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123333.897893:0:14671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+18:14684:x1876031364527616:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 27415us (27742us total) trans 8589934621 rc 0/0 00000100:00100000:1.0:1789123333.897904:0:14671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 53 00000020:00080000:1.0:1789123333.897908:0:14671:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789123333.898575:0:14707:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789123333.898582:0:14707:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789123333.899943:0:14707:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789123333.899953:0:14707:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789123333.902697:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123333.902780:0:14674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364528128 00000100:00100000:3.0:1789123333.902789:0:14674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364528128 00000100:00100000:3.0:1789123333.902834:0:14674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 11 00000100:00100000:3.0:1789123333.902843:0:14674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34048a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+18:14684:x1876031364528128:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789123333.903462:0:14674:0:(mdd_object.c:4024:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789123333.903838:0:14674:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934622 00010000:00010000:3.0:1789123333.903889:0:14674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc931d9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123333.903904:0:14674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc931d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123333.903915:0:14674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc931d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123333.903924:0:14674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc931d9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123333.903931:0:14674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc931d9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123333.903937:0:14674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc931d9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123333.903999:0:14674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789123333.904104:0:14674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34048a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3970986-6c0c-4726-808e-9ec9e5a9682c+20:14684:x1876031364528128:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 Request processed in 1258us (1412us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1789123333.904112:0:14674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 11 00000020:00080000:3.0:1789123333.904117:0:14674:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789123333.905194:0:14659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789123333.905205:0:14659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc931d9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123333.905215:0:14659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbba00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:2.0:1789123333.905220:0:14659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc931d9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123333.905229:0:14659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc931d9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123333.905244:0:14659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f34232f7d00) 00010000:00010000:2.0:1789123333.905247:0:14659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789123333.905252:0:14659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc931d9 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123333.905257:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f3402fbba00/0x7e1648d68fc931d9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123333.905291:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123333.905293:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789123333.905295:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789123334.040682:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1789123334.040735:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123334.040850:0:15360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364528384 00000100:00100000:0.0:1789123334.040860:0:15360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364528384 00000100:00100000:0.0:1789123334.040927:0:15360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364528256 00000100:00100000:0.0:1789123334.040931:0:15360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364528256 00000100:00100000:0.0:1789123334.040952:0:15360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 0 00000100:00100000:0.0:1789123334.040978:0:15360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062cb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+8:2355:x1876031364528384:12345-192.168.206.30@tcp:4:dd.0 00002000:00010000:0.0:1789123334.041029:0:15360:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa3db04, atime: 0x6aa3db03, ctime: 0x6aa3db04, blocks: 0x1 00010000:00010000:0.0:1789123334.041039:0:15360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc931e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123334.041054:0:15360:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1789123334.041059:0:15360:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123334.041065:0:15360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc931e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123334.041081:0:15360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc931e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123334.048943:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1789123334.049667:0:15361:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789123334.049680:0:15361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1789123334.051658:0:15361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364528640 00000100:00100000:0.0:1789123334.051672:0:15361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364528640 00000100:00100000:3.0:1789123334.054244:0:16906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 1 00000100:00100000:3.0:1789123334.054262:0:16906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34062c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+10:2355:x1876031364528256:12345-192.168.206.30@tcp:4:dd.0 00010000:00010000:3.0:1789123334.054309:0:16906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006335ef6c/0x7e1648d68fc931e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123334.054327:0:16906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789123334.054338:0:16906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789123334.054345:0:16906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006335ef6c/0x7e1648d68fc931e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123334.054359:0:16906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006335ef6c/0x7e1648d68fc931e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123334.057997:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123334.058897:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123334.059927:0:15361:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1789123334.060068:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123334.060101:0:15361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1789123334.060136:0:15362:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789123334.060155:0:15362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364528512 00000100:00100000:2.0:1789123334.060165:0:15362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364528512 00000100:00100000:2.0:1789123334.060223:0:15362:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789123334.060228:0:15362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364528896 00000100:00100000:2.0:1789123334.060230:0:15362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364528896 00000100:00100000:1.0:1789123334.060403:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1789123334.060438:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1789123334.060607:0:15362:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1789123334.060614:0:15362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364528768 00000100:00100000:0.0:1789123334.060618:0:15362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364528768 00000100:00100000:0.0:1789123334.060664:0:15362:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1789123334.060672:0:15362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364529024 00000100:00100000:0.0:1789123334.060675:0:15362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364529024 00000100:00100000:0.0:1789123334.060686:0:15362:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1789123334.060691:0:15362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031364529152 00000100:00100000:0.0:1789123334.060693:0:15362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031364529152 00000100:00100000:2.0:1789123334.063050:0:16907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 2 00000100:00100000:2.0:1789123334.063075:0:16907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d3970986-6c0c-4726-808e-9ec9e5a9682c+15:2355:x1876031364528640:12345-192.168.206.30@tcp:4:dd.0 00010000:00010000:2.0:1789123334.063136:0:16907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d778fef9/0x7e1648d68fc931ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123334.063159:0:16907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789123334.063165:0:16907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789123334.063174:0:16907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d778fef9/0x7e1648d68fc931ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789123334.063192:0:16907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d778fef9/0x7e1648d68fc931ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789123334.197342:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:3.0:1789123334.197379:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:3.0:1789123334.197389:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:3.0:1789123334.197397:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:0.0:1789123334.198072:0:15360:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1789123334.198079:0:15360:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1789123332 -> 1789123333 00002000:00010000:0.0:1789123334.198082:0:15360:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789123332 -> 1789123333 00002000:00010000:0.0:1789123334.198085:0:15360:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 6151 00010000:00010000:0.0:1789123334.198113:0:15360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc931e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123334.198127:0:15360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc931e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123334.198136:0:15360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc931e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123334.198145:0:15360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52400 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:0.0:1789123334.198150:0:15360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc931e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123334.198159:0:15360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc931e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123334.198179:0:15360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc931e0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123334.198188:0:15360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ce561f3/0x7e1648d68fc931e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123334.198290:0:15360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062cb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+18:2355:x1876031364528384:12345-192.168.206.30@tcp:4:dd.0 Request processed in 157310us (157611us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1789123334.198301:0:15360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 0 00000100:00100000:0.0:1789123334.198338:0:15360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 3 00000100:00100000:0.0:1789123334.198349:0:15360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+17:2355:x1876031364528512:12345-192.168.206.30@tcp:4:dd.0 00010000:00010000:0.0:1789123334.198387:0:15360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9c2d612/0x7e1648d68fc931f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123334.198399:0:15360:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123334.198404:0:15360:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123334.198410:0:15360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9c2d612/0x7e1648d68fc931f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123334.198423:0:15360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9c2d612/0x7e1648d68fc931f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789123334.259346:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:1.0:1789123334.262314:0:16907:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1789123334.262336:0:16907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d778fef9/0x7e1648d68fc931ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123334.262350:0:16907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d778fef9/0x7e1648d68fc931ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123334.262360:0:16907:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d778fef9/0x7e1648d68fc931ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123334.262369:0:16907:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f342d80a600 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123334.262374:0:16907:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d778fef9/0x7e1648d68fc931ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123334.262399:0:16907:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d778fef9/0x7e1648d68fc931ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123334.262422:0:16907:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d778fef9/0x7e1648d68fc931ee lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123334.262431:0:16907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d778fef9/0x7e1648d68fc931ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123334.262609:0:16907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d3970986-6c0c-4726-808e-9ec9e5a9682c+15:2355:x1876031364528640:12345-192.168.206.30@tcp:4:dd.0 Request processed in 199539us (213675us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789123334.262624:0:16907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 2 00000100:00100000:1.0:1789123334.262684:0:16907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 4 00000100:00100000:1.0:1789123334.262697:0:16907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d3970986-6c0c-4726-808e-9ec9e5a9682c+14:2355:x1876031364528896:12345-192.168.206.30@tcp:4:dd.0 00010000:00010000:1.0:1789123334.262728:0:16907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000280ddb25/0x7e1648d68fc931fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123334.262740:0:16907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123334.262745:0:16907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123334.263152:0:16907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000280ddb25/0x7e1648d68fc931fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123334.263167:0:16907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000280ddb25/0x7e1648d68fc931fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123334.263787:0:16906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006335ef6c/0x7e1648d68fc931e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123334.263799:0:16906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006335ef6c/0x7e1648d68fc931e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123334.263807:0:16906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006335ef6c/0x7e1648d68fc931e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123334.263814:0:16906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbaa00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:0.0:1789123334.263818:0:16906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006335ef6c/0x7e1648d68fc931e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123334.263826:0:16906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006335ef6c/0x7e1648d68fc931e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123334.263853:0:16906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006335ef6c/0x7e1648d68fc931e7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123334.263861:0:16906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006335ef6c/0x7e1648d68fc931e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123334.263924:0:16906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34062c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+14:2355:x1876031364528256:12345-192.168.206.30@tcp:4:dd.0 Request processed in 209665us (223185us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789123334.263934:0:16906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 1 00000100:00100000:0.0:1789123334.263959:0:16906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 5 00000100:00100000:0.0:1789123334.263970:0:16906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+13:2355:x1876031364528768:12345-192.168.206.30@tcp:4:dd.0 00010000:00010000:0.0:1789123334.263991:0:16906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2ba8f2a/0x7e1648d68fc93203 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123334.264001:0:16906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123334.264005:0:16906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789123334.264010:0:16906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2ba8f2a/0x7e1648d68fc93203 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123334.264019:0:16906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2ba8f2a/0x7e1648d68fc93203 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123334.278303:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789123334.305171:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:1.0:1789123334.305834:0:15360:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00010000:00010000:1.0:1789123334.305853:0:15360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9c2d612/0x7e1648d68fc931f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123334.305866:0:15360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9c2d612/0x7e1648d68fc931f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123334.305875:0:15360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9c2d612/0x7e1648d68fc931f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123334.305882:0:15360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52e00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123334.305886:0:15360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9c2d612/0x7e1648d68fc931f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123334.305895:0:15360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9c2d612/0x7e1648d68fc931f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123334.305914:0:15360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9c2d612/0x7e1648d68fc931f5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123334.305921:0:15360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9c2d612/0x7e1648d68fc931f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123334.306061:0:15360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+15:2355:x1876031364528512:12345-192.168.206.30@tcp:4:dd.0 Request processed in 107711us (248075us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1789123334.306089:0:15360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 3 00000100:00100000:1.0:1789123334.306130:0:15360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 6 00000100:00100000:1.0:1789123334.306141:0:15360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+14:2354:x1876031364529024:12345-192.168.206.30@tcp:4:dd.0 00010000:00010000:1.0:1789123334.306172:0:15360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000577c8bfc/0x7e1648d68fc9320a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123334.306184:0:15360:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123334.306189:0:15360:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789123334.306195:0:15360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000577c8bfc/0x7e1648d68fc9320a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123334.306206:0:15360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000577c8bfc/0x7e1648d68fc9320a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789123334.342702:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00000001:00080000:2.0:1789123334.342723:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:3.0:1789123334.342855:0:16907:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:3.0:1789123334.342860:0:16907:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:3.0:1789123334.342875:0:16907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000280ddb25/0x7e1648d68fc931fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123334.342978:0:16907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000280ddb25/0x7e1648d68fc931fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123334.343373:0:16907:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000280ddb25/0x7e1648d68fc931fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123334.343444:0:16907:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401515600 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:3.0:1789123334.343450:0:16907:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000280ddb25/0x7e1648d68fc931fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123334.343451:0:16906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2ba8f2a/0x7e1648d68fc93203 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123334.343476:0:16906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2ba8f2a/0x7e1648d68fc93203 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123334.343493:0:16906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2ba8f2a/0x7e1648d68fc93203 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123334.343495:0:16907:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000280ddb25/0x7e1648d68fc931fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123334.343500:0:16906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3435b52a00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:0.0:1789123334.343503:0:16906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2ba8f2a/0x7e1648d68fc93203 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123334.343511:0:16906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2ba8f2a/0x7e1648d68fc93203 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123334.344171:0:16907:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000280ddb25/0x7e1648d68fc931fc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123334.344172:0:16906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2ba8f2a/0x7e1648d68fc93203 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123334.344184:0:16907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000280ddb25/0x7e1648d68fc931fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789123334.344184:0:16906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2ba8f2a/0x7e1648d68fc93203 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123334.344339:0:16907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d3970986-6c0c-4726-808e-9ec9e5a9682c+11:2355:x1876031364528896:12345-192.168.206.30@tcp:4:dd.0 Request processed in 81641us (285441us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1789123334.344349:0:16907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 4 00000100:00100000:3.0:1789123334.344377:0:16907:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:3.0:1789123334.344387:0:16907:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f34365ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d3970986-6c0c-4726-808e-9ec9e5a9682c+10:2355:x1876031364529152:12345-192.168.206.30@tcp:4:dd.0 00010000:00010000:3.0:1789123334.344419:0:16907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc93211 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123334.344431:0:16907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789123334.344435:0:16907:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789123334.344441:0:16907:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc93211 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123334.344452:0:16907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc93211 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789123334.344990:0:16906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d3970986-6c0c-4726-808e-9ec9e5a9682c+10:2355:x1876031364528768:12345-192.168.206.30@tcp:4:dd.0 Request processed in 81019us (284921us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1789123334.344997:0:16906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 5 00000001:00080000:2.0:1789123334.397807:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:1.0:1789123334.400580:0:15360:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1789123334.400601:0:15360:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:1.0:1789123334.400616:0:15360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000577c8bfc/0x7e1648d68fc9320a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123334.400661:0:15360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000577c8bfc/0x7e1648d68fc9320a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123334.400671:0:15360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000577c8bfc/0x7e1648d68fc9320a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123334.400679:0:15360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3401514c00 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:1.0:1789123334.400694:0:15360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000577c8bfc/0x7e1648d68fc9320a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123334.400704:0:15360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000577c8bfc/0x7e1648d68fc9320a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123334.400725:0:15360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000577c8bfc/0x7e1648d68fc9320a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789123334.400734:0:15360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000577c8bfc/0x7e1648d68fc9320a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789123334.400839:0:15360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d3970986-6c0c-4726-808e-9ec9e5a9682c+9:2354:x1876031364529024:12345-192.168.206.30@tcp:4:dd.0 Request processed in 94698us (340433us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1789123334.400849:0:15360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 6 00000001:00080000:1.0:1789123334.425607:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:3.0:1789123334.425998:0:16907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc93211 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123334.426029:0:16907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc93211 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123334.426038:0:16907:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc93211 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123334.426046:0:16907:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f3402fbb600 already unused, calling callback (ffffffffc17c7550) 00010000:00010000:3.0:1789123334.426050:0:16907:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc93211 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123334.426059:0:16907:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc93211 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123334.426078:0:16907:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc93211 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789123334.426086:0:16907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a61bb24/0x7e1648d68fc93211 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789123334.426223:0:16907:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f34365ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d3970986-6c0c-4726-808e-9ec9e5a9682c+5:2355:x1876031364529152:12345-192.168.206.30@tcp:4:dd.0 Request processed in 81833us (365778us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1789123334.426233:0:16907:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 7 00010000:00010000:2.0:1789123335.300891:0:14659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789123335.602113:0:16946:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:3.0:1789123335.686467:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789123335.686490:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f34365cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381288320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789123335.686569:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789123335.687250:0:15358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876031381288320 00000100:00100000:1.0:1789123335.687258:0:15358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876031381288320 00000100:00100000:1.0:1789123335.687321:0:15358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789123335.687332:0:15358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f3409cb4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381288320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789123335.687367:0:15358:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789123335.687421:0:15358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f3409cb4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876031381288320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789123335.687429:0:15358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789123335.687491:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f34365cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876031381288320:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789123335.689861:0:14667:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789123336.325369:0:14660:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29923 lines, 29923 kept, 0 dropped, 0 bad.